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CHAPTER  I 
INTRODUCTION 

Statement  of  the  Problem: 

The  primary  purpose  of  this  study  is  the  con- 
struction and  evaluation  of  an  objective  achievement  test  to 
measure  the  learning  outcomes  of  a semester  course  in  Work 
Simplification  given  at  the  college  level. 

Justification  of  the  Study 

Despite  statements  by  educators  and  experts  as  to 
the  superiority  in  reliability  and  usability  of  the  objective 
examination  over  the  subjective  type  as  ordinarily  employed, 
there  is  a distinct  lag  in  bringing  practices. to  the  level  of 
theory.*  Since  no  objective  testing  has  been  previously 


* See:  E.  J.  Ashbough,  ’’Reducing  the  Variability  in  Teachers’ 

Marks”,  Journal  of  Educational  Research,  12;  (March, 

1924,  pp7IB'5-187J : 

Leon  M.  Childers,  ’’Report  of  the  Research  Committee  on 
Examination”,  Proceedings  of  the  Sixtieth  Annual  Meet- 
ing, National  Association  of  Dental  Examiners,  60; 
August,  1942,  pp. 77-106). 

J.  D.  Palls,  ’’Research  in  Secondary  Education",  Kentucky 
School  Journal, 6;  (March,  1928,  pp. 42-46). 

C.  E.  Hulten,  "The  Personal  Element  in  Teacher’s  Marks”, 
Journal  of  Educational  Research,  12;  June,  1925.  pp.49- 

J5T- 

Franklin  W.  Johnson,  "A  Study  of  High  School  Grades”, 
School  Review,  19;  (January,  19H,  pp. 13-24). 

Daniel  Starch , "Reliability  and  Distribution  of  Grades”, 
Science , 38;  (October  31,  1913,  pp. 630-636). 

Max  Meyer,  "The  Grading  of  Students”,  Science , 28; 
(August  21,  1908,  pp. 243-250). 
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attempted  in  this  particular  course  in  Work  Simplification, 
there  is  a definite  need  for  an  objective  instrument  of 
measurement  which  will  aid  to  determine  student  achievement 
of  specific  objectives.  Moreover,  the  course  is  taught  by- 
three  different  instructors  under  conditions  where  no  uniform 
testing  practice  has  been  instituted  and  where  instructors* 
marks  are  entirely-  subjective  and  consequently  prone  to  vary. 

If  a satisfactory  objective  instrument  were  used  by  all  the 
instructors,  a student’s  rating  may  then  be  determined  in 
relation  to  that  of  other  students  who  have  been  submitted  to 
the  one  and  same  objective  instrument.  This  procedure  would  be 
preferable  to  the  subjective  method  employed  now  where  each 
instructor  makes  up  his  own  essay  examination  which  he  adminis- 
ters to  his  class  at  the  end  of  the  semester. 

The  problem  also  exists  where  classes  and  examinatioi 
periods  are  scheduled  on  different  days  for  the  three  groups, 
thus  providing  an  opportunity  for  the  essay  questions  in  the 
examination  to  be  communicated  to  interested  students.  To 
avoid  this  situation,  a conference  is  sometimes  held  by  the 
instructors  to  prevent  the  repetition  of  the  same  essay 
questions  in  the  three  examinations.  This  procedure  tends  to 
limit  more  definitely  the  sampling  in  the  essay  examinations 
planned  for  use.  A satisfactory  objective  instrument  could 
call  forth  more  knowledge  that  the  student  actually  possessed, 
could  sample  more  areas  of  instruction,  and  could  not  so 
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readily  be  communicated  to  interested  students. 

It  is  reasonable  to  assume  that  the  subjective  tests 
given  by  the  three  instructors  vary,  some  being  more  difficult 
than  others,  and  possibly  may  be  unfair  to  the  students  en- 
rolled in  the  course . Such  a situation  would  be  remedied  if 
one  reliable  and  valid  instrument  of  measurement  were  used 
by  all  three  instructors  for  all  the  students. 


Scope  and  Limitation 


This  test  was  designed  for  and  administered  to 
thirty-nine  college  students  in  a semester  course  on  Work 
Simplification  given  by  three  instructors.  The  classes  were 
comprised  of  11,  13,  and  13  students,  consisting  primarily  of 
seniors  and  graduate  students.  The  study  is  limited  in  that 
there  are  no  I.Q,s.  obtained  for  the  students  who  were  tested. 
The  validity  of  the  writer fs  test  will  be  analyzed  as  to  test 
form  and  content,  and  the  scores  of  the  objective  test  will 
be  checked  against  the  outside  criteria  of  a subjective  ex- 
amination measuring  the  same  learning  outcomes  and  of  the 
final  grade  in  the  course.  The  test  results  will  be  inter- 
preted for  class  use,  and  the  data  derived  from  the  adminis- 
tration of  the  test  will  be  analyzed  statistically  to  deter- 
mine which  items  discriminate  well  and  which  poorly.  The 
reliability  coefficient  of  the  test  will  be  determined  by 
the  "Chance -Halves"  Method,  with  the  reliability  of  the  whole 
test  estimated  by  the  use  of  the  Spearman-Brown  formula. 
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For  the  purposes  of  this  study,  the  assumption  is 
made  that  knowledge  of  this  particular  subject  matter  in  terms 
of  factual  data  and  understandings  can  be  measured  by  an  ob- 
jective test. 
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CHAPTER  II 

THE  CONSTRUCTION  OF  THE  TEST 


) 


Face  Validity 

The  nature  of  the  thing  being  measured  must  always 
determine  the  methods  and  materials  of  measurement.  In  order 
to  judge  the  validity  of  an  achievement  test,  it  is  necessary 
to  consider  what  it  is  the  achievement  test  is  to  measure. 
Concerning  the  validity  of  educational  tests,  Rulon  states,* 
"Validity  is  usually  described  as  the  extent  to  which  a test 
measures  what  it  is  purported  to  measure.  This  is  an  unsatis 
factory  and  not  a very  useful  concept  of  validity,  because 
under  it  the  validity  of  a test  may  be  altered  completely  by 
changing  its  purport."  Then  continuing  with  this  line  of 
reasoning,  **  "Thus  the  validity  of  a test  may  be  high  for 
one  use  and  low  for  another,  and  the  whole  question  of 
validity  boils  down  to  the  question  whether  the  test  does 
what  we  are  trying  to  do  with  it.  Accordingly,  we  cannot 
label  a test  valid  or  not  valid  except  for  some  purpose. 

This  is  consistent  with  a pragmatic  outlook  on  tests  and 
testing. ” 


* Philip  J.  Rulon,  "Validity  of  Educational  Tests”,  Test 

Service  Notebook,  Number  3,  Division  of  Research  and  Test 
Service,  (World  Book  Co.,  N.Y.,  1947,  p«l)« 


**  Ibid. , p.l. 
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Rulon  continues  with  these  more  specific  statements 
on  the  matter  of  validity:*  "One  thing  that  can  be  looked  at 
in  the  case  of  achievement  tests  is  the  test  content  and  form. 
Tests  require  children  to  perform  certain  operations  upon 
materials  presented  in  the  test.  We  can  ask  about  the  test: 
is  this  the  material  we  are  trying  to  teach  our  children  to 
handle,  and  is  this  the  way  we  are  trying  to  get  them  to 
handle  it?  Answering  such  questions  has  been  called  deter- 
mining the  face  validity  of  the  test.  This  sounds  as  if  it 
were  a rather  superficial  thing;  as  though  we  should  require 
some  more  conclusive  proof  of  the  testTs  validity.  Actually 
there  can  be  no  more  conclusive  proof." 

This  means  that  the  first  step  in  judging  the 
validity  of  an  achievement  test  lies  on  the  basis  of  what  it 
is  we  are  tiying  to  teach  the  students  to  perform.  To  fulfill 
this  criterion,  some  authoritative  statement  of  the  objectives 
of  the  course  in  Work  Simplification  is  necessary.  After  a 
careful  study  of  former  subjective  examinations  in  the  course, 
the  lecture  notes  on  the  course,  and  the  reading  assignments 
required  by  the  course,  the  writer  presented  objectives  on 
Work  Simplification  for  the  approval  of  the  instructors.  The 
instructors  naturally  had  definite  objectives  in  mind  when 


* Rulon,  Op.  cit.,  p.l. 
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teaching  their  materials,  but  these  had  not  been  previously 
formulated  in  writing.  All  the  objectives  submitted  by  the 
writer  were  accepted  as  subscribed,  and  number  12  was  added 
by  the  instructors  to  the  original  list. 

The  test  then  is  designed  to  measure  the  retention 
of  factual  data,  and  the  underlying  principles  and  skills  in 
the  attainment  of  the  following  objectives  in  the  course  on 
Work  Simplification: 

1.  To  gain  a better  understanding  of  the  basic  overall  ob- 
jectives of  industry. 

2.  To  gain  an  understanding  how  Work  Simplification,  "the 
organized  application  of  common  sense  to  find  easier  and 
better  ways  of  doing  work",  effects  improvements  which 
further  the  objectives  of  industry. 

3.  To  gain  knowledge  on  the  beginnings  and  growth  of 
Work  Simplification. 

4.  To  gain  an  understanding  of  the  personality  growth  as 
we 11  as  other  personal  gains  that  may  be  acquired  from 
the  successful  application  of  the  basic  philosophy  of 
progress  upon  which  Work  Simplification  is  based. 

5.  To  gain  an  understanding  that  Work  Simplification  in- 
volves people  and  the  application  of  practical  psychology 
to  enlist  their  cooperation. 

6.  To  gain  an  understanding  of  the  Work  Simplification 
approach  to  improving  existing  methods  in  industry. 
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7.  To  gain  an  understanding  of  the  social  and  psychological 
objections  to  the  use  and  application  of  Work  Simplifi- 
cation and  how  to  overcome  these. 

8.  To  gain  a better  understanding  of  the  effects  of  Work 
Simplification  improvements  in  the  short  run  and  in  the 
long  run. 

9.  To  gain  an  appreciation  of  the  value  of  the  technique 
of  teaching  Work  Simplification  to  the  supervisors  and 
the  men  in  the  plant. 

10.  To  gain  an  understanding  that  management  must  be  suf- 
ficiently proficient  in  the  technical  phases  of  a busi- 
ness in  order  to  form  sound  judgments. 

11.  To  gain  an  understanding  of  the  value  to  administration 
of  the  development  of  the  organization  through  partici- 
pation. 

12.  To  gain  an  understanding  of  the  difference  in  the  several 
approaches  to  Work  Simplification  problems: 

a)  flash  vs.  organized 

b)  analyzed  vs.  practical 

c)  conference  vs.  dictated 

13.  To  gain  knowledge  and  skill  in  using  various  types  of 
charts  for  recording  information  and  work  details,  and 
for  making  an  analysis . 

14.  To  gain  skill  on  how  to  study  charts  in  order  to  work  out 
an  improved  method,  or  solution,  prior  to  putting  the 
new  method  into  practice. 
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15  • To  gain  skill  in  using  charts  as  a means  of  estimating 
the  savings  which  the  new  proposed  method  should  bring 
about,  in  order  to  justify  its  use. 

16.  To  gain  the  skill  of  motion-economy  consciousness  or 
motion-mindedne  ss . 

17.  To  gain  skill  in  presenting  and  selling  improvement 
proposals  to  interested  groups. 

Curricular  Validity 

With  these  objectives  of  progress  in  mind,  the  next 
step  in  the  planning  of  the  test  was  concerned  with  determin- 
ing the  approximate  proportion  of  emphasis  in  the  course  to 
insure  a reasonable  balance  in  the  test.  A careful  study  of 
the  assigned  readings  in  the  textbooks  used  in  the  course 
on  Work  Simplification  was  made  to  determine  the  materials 
to  be  handled  in  the  test.  The  two  basic  texts,  assigned  by 
the  three  instructors,  Motion  and  Time  Study* , by  Ralph  M. 
Barnes  and  Motion  Study**  by  H.  C.  Samp ter,  were  examined  for 
the  materials  treating  the  stated  and  approved  objectives. 
However,  this  would  not  have  necessarily  made  the  test 
equally  valid  for  the  three  instructors  of  the  course,  for 
one  might  be  more  concerned  with  facts  while  the  others  might 
have  been  much  more  concerned  with  understandings  and  the 


* Ralph  M.  Barnes,  Motion  and  Time  Study,  (John  Wiley  & Sons 
N.Y.,  1949) 

**  Herbert  C.  Sampter,  Motion  Study,  (Pitman  Publishing  Co., 
N.Y.,  1941)  
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application  of  facts  to  practical  problems.  Consequently, 
the  amount  of  time  devoted  by  the  instructors  in  the  treat- 
ment of  various  topical  divisions  of  the  course  served  as 
a rough  indication  of  what  was  considered  to  be  the  relative 
importance  of  specific  materials. 

In  addition  to  the  checks  described  above,  sub- 
jective examinations  testing  the  same  learning  outcomes,  and 
which  had  been  administered  by  the  instructors  at  the  college 
in  the  past  three  years  or  more,  were  carefully  studied  with 
emphases  noted.  Mimeographed  sheets,  pamphlets,  and  illus- 
trated materials  which  were  presented  simultaneously  and 
uniformly  by  the  three  instructors  to  their  students  were 
examined  for  focal  points,  and  these  were  recorded.  These 
findings  and  the  lecture  notes  on  the  course  on  Work  Simpli- 
fication served  to  indicate  the  number  of  items  to  be  included 
for  each  objective. 

With  the  objectives  as  a guide  and  the  emphasis  of 
these  objectives  determined  as  adequately  as  possible  in 
the  areas  involved,  test  items  sampling  all  of  the  main  areas 
have  been  written  to  insure  curricular  validity.  As  a fur- 
ther check,  a conference  was  held  with  the  head  of  the  Work 
Simplification  department  and  the  instructors  during  which 
the  prepared  test  items  were  interpreted  and  criticized. 

Some  items  covering  points  of  doubtful  importance,  and  others 
about  which  there  was  disagreement  as  to  answers,  were  elimi- 
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Description  of  the  Test 

The  test  prepared  by  the  writer  was  the  new  type 
objective  examination  containing  131  questions  with  a possible 
total  score  of  233.  The  test  included  several  types  of  items 
in  an  attempt  to  meet  the  requirement  that  the  type  of  test 
situation  should  be  the  one  which  is  most  appropriate  to  the 
materials  to  be  included.  The  test  was  divided  into  five 
unequal  parts,  containing  precise  directions  for  each  section. 

Part  I consisted  of  forty-seven  multiple -choice 
items  meeting  the  objectives  dealing  with  the  factual  data 
and  fundamental  understandings  of  the  background  materials. 

Ross  claims,  * "The  multiple  choice  item  is  usually  regarded 
as  the  most  valuable  and  most  generally  applicable  of  all 
test  forms.”  Lee  regards  it  as  **  "one  of  the  best  means  for 
testing  judgment  that  is  available.”  Lindquist  states  that 
it  is***”definitely  superior  to  other  types"  for  measuring  such 
educational  objectives  as  "inferential  reasoning,  reasoned 
understanding,  or  sound  judgment  and  discrimination  on  the 
part  of  the  pupil”. 


* C.  C.  Ross,  Measurement  in  TodayTs  Schools,  (Prentice -Hall, 
Inc.,  N.Y.,  1947,  p.145. ) 

**  I.  Murray  Lee,  A Guide  to  Measurement  in  Secondary  Schools, 
(D.  Appleton  Century  Company,  N.Y.,  1936,  p.3?9.) 

***  Herbert  E.  Hawke s,  E.  F.  Lindquist,  and  C.  R.  Mann,  The 

Construction  and  Use  of  Achievement  Examinations, (Houghton 
Mifflin  Company,  Boston,  1936,  p.ll6) 
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Part  II  contained  thirty-two  multiple -response 
items  of  uneven  length  dealing  with  Work  Simplification  pro- 
cedures and  the  Work  Simplification  philosophy.  Each  of 

the  questions  or  incomplete  statements  in  this  section  was 
follcwed  by  several  answers,  of  which  one,  two,  three,  all, 
or  any  number  of  the  answers  might  be  correct  for  each  item. 
The  items  on  Work  Simplification  philosophy  were  provided  with 
an  additional  answer  space  where  the  student  might  express 
his  own  point  of  view  if  it  differed  from  that  indicated  in 
the  prepared  responses  to  be  checked.  The  total  possible 
score  in  this  section  was  ninety-one. 

Part  III  contained  eight  matching  items  of  uneven 
length,  with  the  possible  total  score  of  fifty-one.  These 
items  met  the  objectives  concerned  with  motion-mindedne ss  and 
the  practical  application  of  the  principles  in  motion  economy. 
Items  of  this  form  were  selected  to  test  the  types  of  learn- 
ing which  involved  the  association  of  two  things  in  the  mind 
of  the  learner.  The  matching  test  is  a very  convenient  form 
of  exercise  for  measuring  such  learning.  In  the  words  of 
Lindquist,  * "The  matching  exercise  is  particularly  well 
adapted  to  testing  in  who,  what,  when,  and  where  types  of 
situations,  or  for  naming  and  identifying  abilities". 


* Herbert  E.  Hawkes,  E.  F.  Lindquist,  and  C.  R.  Mann, 
op.  cit. , p.150. 
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Part  IV  contained  fifteen  items  to  be  arranged  in 
sequence,  and  was  designed  to  test  an  over-all  understanding 
of  the  step-by-step  procedure  in  the  application  of  the 
Work  Simplification  Pattern. 

Part  V contained  twenty-nine  evaluation  items  meet- 
ing  the  objectives  dealing  with  the  practical  psychology  in 
the  presentation,  the  application,  and  the  selling  of  Work 
Simplification  to  interested  groups. 

The  test  was  designed  to  be  unusually  long  since 
it  is  a preliminary  draft  permitting  "culling  out"  later  on 
any  items  that  may  seem  weak  or  not  needed  to  produce  the 
proper  balance  in  the  test.  Approximately  25 $ more  items 
were  prepared  than  are  likely  to  be  required. 

Administration  of  the  Test 

Before  the  administration  of  the  writer's  test,  each 
instructor  administered  first,  to  his  respective  class,  his 
two-hour  subjective  achievement  examination  consisting  in  each 
case  of  ten  discussion  questions,  which  he  weighted  and  scored 
on  the  basis  of  100$.  The  discussion  questions  used  were  of 
the  type  (1)  describe,  (2)  explain,  (3)  what,  (4)  develop, 

(5)  summarize.  The  amount  of  discussion  required  for  each 
question  was  indicated  by  the  number  of  lines  prepared  be- 
neath  each  question,  where  the  response  was  to  be  made.  In 
grading  the  papers,  each  instructor  had  prepared  a list  of 
the  main  points  which  should  be  discussed  in  every  answer, 
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and  each  of  these  points  was  weighted  and  assigned  a certain 
value.  One  question  was  graded  through  all  the  papers  before 
another  question  was  considered. 

After  a short  interval,  varying  with  the  schedule 
of  classes,  the  objective  examination  prepared  by  the  writer 
was  administered  by  each  instructor  to  the  students  in  his 
respective  classroom,  with  a brief  explanation  of  the  experi- 
ment involved.  The  students  were  allowed  all  the  time  they 
needed  to  complete  the  examination  in  order  to  secure  the 
data  necessary  to  better  determine  the  difficulty  and  the 
discriminating  value  of  the  items.  The  examiner  recorded 
the  time  required  by  each  student  to  complete  the  examination 
so  that  the  information  might  be  used  in  determining  the  time 
allowances  for  later  revisions  of  the  test.  The  test  was 
taken  in  two  sittings  by  most  of  the  students,  for  the  test- 
ing time  required  ranged  from  4 hours  and  50  minutes  to 
1 hour  and  45  minutes,  with  the  average  student  completing 

the  items  in  2 hours  and  20  minutes.  The  instructors 
returned  the  papers  to  the  writer  for  scoring  and  interpre- 
tation. Upon  scoring  the  papers,  the  writer  gave  the  indi- 
vidual test  results  to  the  instructors,  indicating  the  range 
of  scores  and  the  class  median,  so  that  the  students  as  well 
as  the  instructors  were  aware  of  the  test  results  before  the 


semester1 s end. 
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OBJECTIVE  TEST  IN  WORK  SIMPLIFICATION 


lour  Name 


Instructor 


Directions:  This  is  a test  of  your  knowledge  of  Work 

Simplification  based  on  the  lectures*  readings,  and 
mimeographed  sheets  given  you  during  the  semester.  The 
test  has  five  sections  of  unequal  parts.  The  directions 
for  each  section  are  printed  at  the  beginning  of  the 
section.  When  you  are  told  to  begin,  turn  to  Section  I, 
read  the  directions,  and  proceed  to  answer  the  questions. 
No  questions  will  be  answered  concerning  the  exam  after 
the  period  begins.  You  will  be  allowed  all  the  time  you 
eed  to  complete  the  exam. 


Possible  Score  Actual  Score 

A?  Part  1 

91  - Part  2 

51  Part  3 

Part  4 

29  Part  5 

23 1 Total  


. 

. 

. 
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PART  I 


Directions?  Each  of  the  incomplete  statements  or 
questions  below  is  followed  by  four  possible  answers. 
Select  the  answer  that  best  completes  the  statement 
(or  best  answers  the  question)  and  put  its  letter  in 

— 


1.  Machine  Utilization  Time  is  equal  to? 

a.  Machine  time  divided  by  operator  effectiveness. 

b.  Total  cycle  time  divided  by  machine  time. 

c.  Machine  time  divided  by  total  cycle  time. 

d.  Machine  time  divided  by  total  man  time  plus  the 
total  cycle  time. 

2.  The  people  in  all  three  corners  of  the  ” American  Triangle 
of  Plenty”  are? 

a.  Uncooperative  because  they  represent  conflicting 
objectives. 

b.  Becoming  less  and  less  the  same. 

c‘.  Becoming  increasingly  the  one  and  same. 

d.  Are  remaining  fairly  constant  in  their  allotted  positions 

3.  Work  Simplification  results  in  cost  reduction  by  a 
scientific  application  of  : 

a.  price  rates. 

b.  the  speed  up. 

c.  time  study. 

d.  common  sense. 

4.  In  using  a flow  process  chart,  the  correct  procedure  in- 
volves the  sequence  of  the  following  steps; 

a.  Select  the  subject  to  follow. 

Decide  a place  to  start  and  a place  to  end. 

Record  a brief  description  of  each  detail. 

Apply  the  symbols. 

b.  Decide  a place  to  start  and  a place  to  end. 

Apply  the  symbols.  , 

Select  the  subject  to  follow. 

Record  a brief  description  of  each  detail. 

c.  Select  the  subject  to  follow. 

Apply  the  symbols. 

Decide  a place  to  start  and  a place  to  end. 

Record  a brief  description  of  each  detail. 

d.  Decide  a place  to  start  and  a place  to  end. 

Select  a subject  to  follow. 

Apply  the  symbols. 

Record  a brief  description  of  each  detail. 


* 
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5.  Dr.  Snyder  has  proved  that  most  of  the  new  capital  put 

into  American  business  comes 2 

a.  From  the  savings  of  the  workers. 

b.  From  the  profits  of  those  businesses  themselves. 

c.  As  a result  of  high  war  earnings. 

d.  From  new  investors  in  those  businesses. 

6.  In  a process  flow  chart*  the  symbol  O means; 

a.  Transportation. 

b.  Storage. 

c.  Inspection. 

d.  Operation. 

7.  In  challenging  the  details*  the  questions  "What?*,  "Why?" 

lead  to; 

a.  Combination  of  details. 

b.  Elimination  of  details. 

c.  Relocation  within  the  work  area. 

d.  Changes  of  sequence. 

8.  The  proper  order  in  the  application  of  the  w Quest. ionning 

Approach*  to  the  Process  Chart  analysis  is; 

a.  Elimination 
Combination 
Change  of  sequence 
Simplification 

b.  Change  of  sequence 
Simplification 
Elimination 
Combination 

c.  Simplification 
Elimination 
Change  of  sequence 
Combination 

/ 

d.  Elimination 
Cha.nge  of  sequence 
Combination 
Simplification 

9.  In  challenging  the  details,  the  questions  "When?*,  "Why* 

lead  to; 

a.  Rearrangement  of  tools. 

b.  Change  of  sequence 

c.  Combination  with  "do*  details. 

d.  Elimination  of  details. 


. , 
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17*  In  developing  an  Improved  method  on  the  Flow  Process  Chart* 

we  begin  by  concentrating  first  o m 

a.  The  transportation  details. 

b.  The  storage  details. 

c.  The  operation  details. 

d.  The  inspection  details. 

18.  Dr.  Siichter  in  the  Harvard  Business  Review  claims  that 
the  conditions  which  make  it  possible  to  arrive  at  both 
larger  profits  and  higher  wages; 

a.  Are  the  very  same  conditions. 

b.  Cannot  be  present  simultaneously. 

c.  Are  fundamentally  contradictory. 

d.  Cannot  lead  to  cooperation  between  labor  and  capital. 

19.  In  a Flow  Process  Chart  the  symbol means i 

a.  Storage. 

b.  Transportation. 

c.  Inspection. 

d.  Operation. 


20.  The  motions  usually  used  by  mo3t  individuals  in  turning 
the  pages  of  a book  ares 


a.  Finger  motions. 

b.  Motions  involving  fingers  and  wrist. 

c.  Motions  involving  fingers,  wrist*  and  forearm. 

d.  Motions  involving  fingers*  wrist*  forearm*  and  upper  am, 

i 

21.  The  over-all  commen  sense  procedure  in  the  analysis  of  work 
with  a view  to  simplifying  it  involves; 


a .  Breakdown 
Challenge 
Rebuild 


c.  Challenge 
Breakdown 
Rebuild 


b.  Simplify 
Challenge 
Rebuild 


d.  Challenge 
Rebuild 
Simplify 


22.  The  worst  thing  outside  of  complete  Idleness  that  an  opera- 
tor chart  can  show  a hand  doing  is; 


a.  Holding. 

b.  Changing  sequence. 

c.  Slow  motions. 

d.  Short  cycles.  ■ 


23.  In  small  parts  assembly,  the  following  general  improvement 
common  to  so  many  jobs  should  be  tried; 

a.  Circular,  rhythmical  motion. 

b.  Elimination  and  reduction  of  make  ready. 

c.  Prepositioning  of  tools. 

d.  Two  at  a time. 


24-  The  miajor  difference  between  the  two  general  types  of  plant 

layout  now  in  common  use  is: 

a.  One  type  is  continuous  while  the  other  is  intermittent. 

b.  One  is  named  Product  Controlled  Layout  while  the  other 
is  Process  Controlled  Layout. 

c.  One  has  voluminoxis  paper  work  required  while  the  other 
does  not. 

d.  One  has  automatic  or  semi-automatic  means  while  the 
other  does  not. 

25.  For  recording  and  analyzing  any  single  operation  we  use: 

a.  A method  of  therblig  symbols  because  a less  sharply  de- 
fined picture  is  needed. 

b.  The  Simo  Chart. 

c.  The  Right  and  Left  Hand  Chart. 

d.  The  Flow  Diagram. 

26.  The  most  valuable  use  for  micro  motion  or  therbig  analysis 

is: 

a.  Its  application  on  small  production  on  long  cycles. 

b.  Its  application  to  compute  the  importance  of  major 
motions. 

c.  Its  application  to  discriminate  between  important  and 
unimportant  motions. 

d.  Its  application  to  make  one  realize  the  importance  of 
the  smallest  motion. 

27.  Details  requiring  similar  skills  or  little  skill  ares 

a.  More  readi3,y  combined  than  highly  skilled  details. 

b.  Less  easily  combined  than  highly  skilled  details. 

c.  Combined  v/ith  production  details  with  automatic  saving 
in  rehandlings. 

d.  Easily  combined  for  an  improvement  in  quality. 

28.  The  biggest  advantage  of  a Flow  Process  Chart  is  that: 

a.  It  serves  as  an  instruction  sheet  for  trying  out  the 
proposed  method. 

b.  It  serves  as  a "follow  up"  check  to  see  if  the  new 
method  is  being  maintained  in  use. 

c.  It  can  be  referred  to  as  a definite  fact  since  it  was 
made  by  actual  observation  on  the  Job. 

d.  It  can  be  used  for  training  new  operators  how  to  perform 
the  Job. 

29.  Most  plants  in  industry  are  laid  out  along  the  principles 

a.  Product  Controlled  Layout. 

b.  Process  Controlled  Layout. 

c.  A combination  with  the  emphasis  on  Product  Controlled 

Layout. 

d.  A combination  with  the  emphasis  on  Process  Controlled 
Layout . 


. 

. 
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30.  American  industry  leaves  large3.y  untapped  its  greatest  re- 
source which  is: 

a.  The  intelligence  and  initiative  of  its  workers. 

b.  Managerial  ability. 

c.  By-products  in  the  manufacturing  process. 

d.  Latent  raw  materials. 

31.  Work  simplification  applies? 

a.  To  work  in  a broad  sense  of  a complete  process  or 
operation. 

b.  To  work  on  parts  of  a complete  process. 

c.  To  large  numbers  as  well  as  combinations  of  isolated  jobs 

d.  To  work  in  a complete  process  or  operation  as  well  as 
isolated  jobs. 

32.  The  universal  tool  of  Work  Simplification  is: 

a.  The  Operator  Chart. 

b.  The  Flow  Diagram. 

c.  The  Flow  Process  Chart. 

d.  The  Multiple  Activity  Chart. 

33.  The  start  of  ^motion  study n dates  to: 

a.  The  last  half  of  the  17th  century. 

b.  1883  with  Frederick  Winslow  Taylor. 

c.  1917  with  Frank  B.  Giibreth  and  Dr.  Lillian  M.  Gilbreth. 

d.  Mr.  Alien  H.  Mogensen  and  work  simplification. 

34-  In  F.C.  Crawford’s  ” American  Triangle  of  Plenty”  the  re- 
lationship of  management  to  other  people  is  depicted  by  its 
position? 

a.  At  the  lower  right  corner. 

b.  At  the  top  corner. 

c.  In  the  middle  of  the  triangle. 

d.  At  the  lower  left  corner. 

35.  Inspections by  wfeelff  or  "touch”  when  they  do  occur  are  the 
kind  that  are* 

a.  Not  represented  in  an  operator  chart. 

b.  Seldom  represented  in  an  operator  chart. 

c.  Not  represented  by  a "hold”  or  "delay”  motion. 

d.  Represented  in  an  operator  chart. 

36.  When  balancing  work  between  the  two  hands,  it  is  usually 
desirable: 

a.  To  have  the  hands  proceed  in  opposite  and  symmetrical 
direction. 

b.  To  have  the  hands  proceed  in  the  same  and  symmetrical 
directions. 

c.  To  have  the  hands  use  alternate  motions. 

d.  To  have  the  hands  perform  simultaneous  motions. 


37.  The  motions  used  by  most  individuals  in  pouring  a glass  of 

milk  ares 

a.  Motions  involving  fingers  and  wrist. 

b.  Motions  involving  fingers*  wrist*  forearm,  and  upper  arm. 

c.  Motions  involving  fingers,  wrist,  and  forearm. 

d.  Motions  involving  fingers,  wrist,  forearm,  upper  arm, 
and  shoulder. 

38.  In  over-all  motion  study  the  term  * savings  on  the  work  in 
process”  refers  to: 

a.  Economics  of  direct  labor  in  the  factory. 

b.  Economics  of  supervision  in  the  factory. 

c.  Savings  such  as  handling  materials  in  the  factory. 

d.  Savings  in  the  amount  of  material  in  the  factory. 

39.  In  using  a Flow  Process  Chart,  should  a doubt  arise  as  to 
whether  or  not  the  detail  should  be  considered  a ”do” 
detail! 

a.  Leave  it  out  for  the  time  being. 

b.  Shade  it  in  anyway. 

c.  Determine  whether  it  changes  the  condition  of  the 
product. 

d.  Sketch  a flow  diagram  of  the  process. 

40.  Motion  study  holds  to  the  principle  that: 

a.  The  shortest  and  the  speediest  way  is  the  best. 

b.  Opposite  motions  are  better  than  alternate  motions. 

c.  Alternating  motions  are  better  than  straight  motions. 

d.  Circular  motions  are  better  than  straight  motions. 

41.  The  essential  difference  between  the  work  of  Taylor  and 
Gilbreth  was: 

a.  Taylor  used  motion  study. 

b.  Gilbreth  used  time  study. 

c»  Taylor1 s main  objective  was  to  find  the  correct  time, 
d.  TaylorTs  main  objective  was  to  find  the  correct  method. 

42.  In  a Flow  Process  Chart  pick-ups  and  lay-downs  within  a 
work  area  are  usually  considered? 

a.  Transportations. 

b.  Operations. 

c.  Inspections. 

d . Combinations . 

43 « Workers  in  general  erroneously  feel  that  if  pi*oduction  is 
doubled  through  application  of  Work  Simplification: 

a.  They  are  using  twice  as  much  energy. 

b.  Theyfve  laid  down  on  th^  job. 

Co  They  are  creating  a higher  standard  of  living, 
d.  They r re  reducing  the  cost  of  the  product. 
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44*  The  first  problem  in  applying  work  sj^plific'  tior. 

to  a specific  job  involves* 

a.  The  idea  of  finding  an  easier  and  better  way. 

b.  The  making  of  a better  product  at  a lower  cost, 
c*  The  minimizing  of  inherent  selfishness  in  people. 

d.  The  overcoming  of  resistance  to  change  and  the  resentment 
of  criticism. 

45*  We  attempt  to  improve  the  details  themselves  in  Step  IV 
of  the  Work  Simplification  Patterns 

a.  After  we  have  established  the  details  we  must  perform. 

b.  Before  we  have  established  the  order  in  which  we  have  to 

do  them. 

Co  After  we  have  established  the  details  we  must  perform 
and  the  order  in  which  we  have  to  do  them, 
d.  After  we  have  eliminated  duplication  and  unnecessary 
effort. 

46.  In  making  a Flow  Process  Chart  if  you  find  that  one  detail 
requires  more  than  one  symbols 

a«  The  description  you  have  written  is  not  correct  for  the 
symbol  used. 

b.  You  are  using  too  many  symbols  for  one  description. 

c.  You  have  not  broken  the  job  down  far  enough. 

d.  You  have  not  used  the  proper  symbols. 

47.  In  making  a Flow  Process  Chart  inspection  details  which 
exist  all  by  themselves  and  have  nmake-readyw  and  nput~away*' 
details  depending  on  them* 

a.  May  be  shaded  if  they  change  the  condition  of  the 
product. 

b.  May  be  shaded  even  though  they  do  not  change  the  con- 
dition of  the  product. 

c.  May  be  indicated  by  the  symbol  O • 

d.  May  be  indicated  by  the  symbol  Q . 


* 


* 
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PART  II 


[Directions t~  Each  of  the  questions  or  incomplete  state-1 
taents  below  is  followed  by  several  answers.  One,  two, 
three,  all,  or  any  number  of  the  answers  may  be  correct: 
for  each  item.  Select  the  answers  that  are  correct  and:" 
olace  a check  (*/)  before  their  letters  in  the  answer 

— I 


48.  In  preparing  an  Operator  Chart  the  holding  of  an  object  in  the 
hand  may  be  indicated 3 

a.  By  a special  symbol. 

b.  By  a straight  line  without  symbols  for  the  hands. 

c.  As  an  operation. 

d.  By  the  symbol"^. 

49.  Backtracking  and  rehandling  can  often  be  greatly  reduced  or  even 
eliminated  by? 

^ a.  A flow  d-agram. 

_____  b.  A templet  layout. 

c.  Changing  the  sequence  of  details. 

d.  Establishing  additional  details  which  must  flow  in  a definite 
order. 

50.  In  preparing  a Flow  Process  Charts 

a.  It  is  always  necessary  to  actually  observe  the  operation. 

_____  b.  It  is  easy  for  one  familiar  with  the  process  to  make  a 
correct  chart  from  memory. 

_____  c.  It  is  necessary  to  include  the  details  of  any  one  operation. 

d.  It  is  difficult  to  chart  every  operation. 

51.  Initial  steps  in  recording  the  activities  of  the  hands  in  making 
an  Operator  Chart  arei 

_____  a.  To  watch  what  the  right  hands  and  left  hands  are  doing  and 
record  the  motions  simultaneously. 

b.  To  watch  the  hand  that  does  the  most  work  and  record  its 

movements  first. 

_____  c.  To  draw  one  symbol  within  another  to  indicate  points  which 
occur  simultaneously. 

d.  To  watch  for  any  simultaneous  movement  to  record  system- 
atically on  the  sheet. 

52.  The  objections  of  psychologists  to  Work  Simplification  are 
based  ons 

' a.  Its  effect  on  mass  production. 

_____  b.  Implied  disregard  for  the  individual  differences  of  the 

operator. 

c.  The  philosophy  that  there  is  no  one  best  way  for  any  job. 

______  d.  The  keyed-up  sense  of  operators  on  motion- studied  jobs. 


53.  Which  of  the  following  may  be  utilized  to  allay  fear  of  unem- 
ployment in  the  application  of  a Work  Simplification  program? 

a.  The  labor  turnover. 

' b.  The  basic  economic  system. 

c.  Seasonal  changes  in  employment. 

d.  Increased  production. 

54.  Important  factors  for  eliminating  wmake~readyw  and  "put  away” 
time  often  neglected  in  man-machine  applications  are: 

a.  Elemental  breakdown  of  motions. 

b.  Prepositioning  of  tools. 

c.  Work  space  layout. 

~ d.  Use  of  ejectors. 

55.  Some  classifications  of  the  Break-down  of  a Process  Chart  are: 

_____  a.  Operation. 

b.  Simplification. 

_____  c.  Inspection. 

_ 2 d.  Transportation. 

56.  Some  specific  conclusions  relating  to  the  attitude  of  workers 
and  their  efficiency  are: 

_____  a.  The  amount  of  sleep  has  a slight  but  significant  effect 
upon  individual  performance. 

_ b.  Total  daily  productivity  is  decreased  by  rest  periods. 

_____  c.  A distinct  relationship  exists  between  the  home  condition 

of  the  workers  and  their  performance. 

d.  The  mental  attitude  of  the  operators  toward  the  supervisor 

and  working  conditions  is  probably  the  biggest  single  factor 
governing  employee  efficiency. 

57.  In  advancing  the  basic  Work  Simplification  Pattern  we  agree  that: 

a.  The  idea  of  finding  better  ways  of  doing  work  is  new. 

_____  b.  Successful  management  for  years  has  found  better  ways  of 

doing  work. 

_____  c.  The  organization  of  the  -chink Jng  in  terms  of  a specific 
pattern  is  new. 

_____  d.  The  pattern  is  the  result  of  Dr.  Gilbreth’s  efforts. 

58.  The  social  objections  to  Work  Simplification  have  been  based 
largely  on: 

a.  The  "personalized  approach”  generally  used  in  most  factories. 

_____  b.  The  "research  point  of  view”. 

____  c.  The  usual  objections  to  any  increase  of  production  per 
operator. 

_____  d.  The  unemployment  caused  by  improvements  in  machines  or 
methods. 


. 

' 


. 


' 


. 


■ 
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59.  The'  fundamental  circular  work  space  layout  diagram  is  based 

on  which  of  the  following? 

• a.  The  five  classifications  of  motion. 

~ ___  b.  The  elimination  of  idle  times  for  each  hand. 

___ J e.  Smooth,  circular,  rhythmical  motions. 

d.  The  computation  of  ,’motion-mindednessr? . 

60.  The  following  are  important  considerations  with  regard  to  a 
specific  product  you  might  produce  before  deciding  to  trend 
toward  product  controlled  or  process  controlled  layout  of  the 
manufacturing  plants 

______  a.  Certainty  of  product  design. 

______  b.  Certainty  of  competent  employees. 

c.  Volume  of  production  output. 

___ d.  Certainty  of  supply  of  materials. 

61.  According  to  Dr.  Arthur  D.  Little,  which  of  the  following  are 
marks  of  a scientific  mind  that  help  to  ^Challenge  Every  Detail^? 

__ __  a.  The  power  to  observe  intelligently. 

_____  b.  The  simplicity  to  wonder. 

_____  c.  The  ability  to  question. 

______  d.  The  power  to  generalize 

_____  e.  The  capacity  to  apply. 

62.  The  Flow  Process  Chart  becomes  the  means  of  applying  the  Work 
Simplification  Pattern  bys 

a.  Selecting  the  job  to  be  improved. 

______  b.  Becoming  the  job  breakdown  in  step  2. 

______  c.  Becoming  the  work  sheet  for  applying  steps  3 and  4* 

~ _ d.  Becoming  a summary  sheet  for  selling  the  idea  in  step  5. 

63.  Which  of  the  following  are  advantages  to  lookfhr  in  a product 
controlled  layout? 

_____  a.  Will  a change  to  product  controlled  layout  reduce  trans 
portation  costs  and  requirements? 

b.  Will  it  give  greater  flexibility? 

______  c.  Will  it  reduce  the  material  handling  by  the  workers? 

d.  Will  losses  from  machine  breakdowns  and  technical  work 

stoppages  be  less? 

_______  e.  Will  required  management  control  be  easier? 

f.  Is  it  an  advantage  to  separate  operations  by  departments 

because  of  working  conditions? 


64.  Work  Simplification  applies  to 


a.  Factory  operations. 

b.  Office  and  clerical  work. 

_ c.  Receiving  and  distribution  of  mail. 

' d.  Housework. 

__  e.  Production  orders. 

f.  Instructions  Issued  to  the  plant. 

~ g.  arrangement  of  individual  aesks. 

_____  h.  Layout  of  various  paper  forms. 

i.  Typewriting. 

j.  Punctuation. 

__ k.  Design  of  parts*  fixtures*  and  machines. 

1.  Location  of  pencil  sharpeners. 

65.  Which  of  the  following  are  correct  and  adequate  guides  in 
making  a Flow  Process  Chart  and  a Flow  Diagram? 

. a.  Determine  the  activity  to  be  studied, 

_ _ b.  Decide  whether  you  will  follow  the  person  and  the  part, 

the  material,  or  a printed  form. 

_ __  c.  Allow  ample  space  on  the  sheet  for  (1)  heading  (2)  descrip- 

tion (3)  summary. 

. d.  Choose  a definite  starting  point  and  decide  later  on  the 
ending  point. 

e.  The  body  of  the  Flow  Process  Chart  will  consist  of  a column 

for  the  transportation  and  its  description. 

___  f.  Show  the  number  of  operations,  the  number  of  Inspections, 
and  the  number  of  storages  on  the  tabular  summary. 

_ go  After  improvements  have  been  made,  compile  a combined  sum- 
mary giving  information  for  the  old  method,  the  proposed 
method,  and  the  difference. 

__  h.  When  practical  obtain  floor  plans  of  the  department  of  the 
plant  showing  the  location  of  machines  and  equipment  used 
in  making  the  part. 

_____  i.  If  these  are  not  available,  draw  plans  to  scale. 

__  j.  Draw  in  the  floor  plans  in  pencil,  the  path  of  the  part 
through  the  plant,  noting  the  direction  of  travel. 

___  k.  Measure  the  distances  accurately  with  a steel  tape. 


Directions s The  following  items  deal  with  Work  Simplification  j 
philosophy.  Following  the  same  directions,  check  the  correct 
answers  as  emphasized  in  the  course.  If  your  own  point  of  viewf 
differs  from  that  expressed  in  the  answers  you  have  checked, 
write  your  comment  in  the  blank  space  provided.  I 

66.  Which  of  the  following  are  gains  you  may  acquire  by  using  the 
Work  Simplification  philosophy? 

_ a.  You  may  add  to  your  interest  and  understanding  of  people. 

b.  You  may  find  new  interest  in  your  responsibilities. 

_ „ c.  You  may  develop  an  ability  to  organize  your  thinking  in  a 

better  way. 

d.  You  may  enhance ycur  opportunities  for  advancement. 

e.  


. 

. 

' 


' 


67.  Simple  .techniques  to  get  cooperation  in  dealing  with  people  in 
a Work  Simplification  problem  ares 

_____  a.  Forcefully  presenting  to  the  worker  the  idea  that  there's 
a better  way. 

, b.  Appealing  to  the  worker's  knowledge  of  the  job. 

c.  Explaining  to  the  worker  your  knowledge  of  the  field. 

’ d.  Giving  the  worker  a part  in  the  planning  of  the  improvement, 
e.  

63.  Work  Simplification  satisfies  requirements  of  the  investors 
because? 

The  premise  is  that  "there  is  always  a better  way". 

Work  Simplification  calls  for  better  utilization  of  present 
facilities  rather  than  additional  investment. 

Work  Simplification  shares  cost  reduction  with  the  consumer. 
Work  Simplification  helps  the  investor  to  be  the  lowest 
cost  producer  and  distributor  in  the  field. 


69.  The  Work  Simplification  approach  to  a job  develops; 

______  a.  A set  of rules  which  if  followed  faithfully  will  give  the 

desired  results. 

b.  A logical  manner  of  thinking,  in  setting  up  rules  for  a job. 

c.  A logical  manner  of  thinking’  through  a number  of  possibili- 
ties so  that  a proper  consideration  will  be  given  to  each. 

d.  A logical  manner  of  thinking  to  set  up  rules  as  the  reason 

for  making  decisions  and  improvements. 


70.  Work  Simplification  helps  satisfy  the  following  needs  of  the 
consumer : 

_____  a.  Increasingly  better  products  at  lower  and  lower  prices. 

b.  Sharing  in  cost  reduction. 

c.  Increasing  the  standard,  of  living. 

" d»  Protection  against  inflation. 

e . . .. .. _ __ __ _____ 

71.  The  application  of  Work  Simplification  and  labor-saving 
machinery  includes  in  its  philosophy  the  idea  that; 

i 

_____  a.  Unemployment  will  be  created. 

___  b.  Employment  will  be  created. 

c.  Purchasing  power  will  be  unaffected. 

. d.  Employment  will  be  unaffected. 

e. ' - 


72.  The  most  satisfactory  way  of  dealing  with  people  in  order  to 
get  cooperation  in  a Work  Simplification  Program  is  usually 
based  on: 

______  a.  The  personal  approach. 

b.  The  purely  analytical  approach. 

- c.  The  precedent  approach. 

The  "intelligently  selfish"  approach. 


ry  ~ 

fj  ' 


Industrial  managers  in  order  to  maintain  their  objectives  must* 


a.  Satisfy  the  main  objectives  of  the  worker,  consumer, .and 

investor. 

b.  Have  self-expression  without  fear  of  the  worker,  consumer 

and  investor. 

c.  Have  a position  of  authority  in  making  decisions.-. 

d.  Have  recognition  of  their  true  worth  by  worker,  consumer, 
and  investor. 


74*  Work  Simplification  helps  to  satisfy  the  following  needs  of 
Top  Managements 

a.  More  ideas  and  more  management  coming  from  the  bottom  up. 

~~  b.  Easing  of  the  management  load. 

c.  Security  on  the  job  with  a better  salary. 

~ d.  better  distribution  of  the  management  load. 


75-  Work  Simplification  helps  to  satisfy  the  following  desires  of 
the  workers 


a.  Better  housing. 

b.  More  leisure. 

c.  Steady  work. 

d.  Fair  wages. 

e.  Good  working  conditions. 

f.  Recognition  of  his  individual  worth. 


76.  The  best  qualified  group  to  suggest  and  put  through  improvements 
in  a Work  Simplification  program  ares 

_____  a.  Experts  or  analysts  trained  in  Work  Simplification. 

___  b.  Foremen  trained  in  Work  Simplification. 

_____  c.  Men  on  the  job  who  have  been  taught  Work  Simplification 
methods. 

_ , d.  Managers  of  the  plants. 

e . ___ 

1 

77.  An  underlying  tenet  in  the  philosophy  of  Work  Simplification 
generally  emphasizes  that  the  only  thing  that  creates  increased 
purchasing  power  is* 

a.  Hew  and  better  equipment. 

_____  b.  Increased  productivity. 

______  c.  Work  simplification. 

_ _ d.  Better  industrial  management. 

e.  


78.  ’’Human  nature”  characteristics  that  must  be  overcome  in  the 

Operator,  Foreman,  or  Executive  before  Work  Simplification  can 
be  successfully  applied  are? 

_____  a.  Resistance  to  ’’speed-up”. 

_______  b.  Resentment  of  criticism. 

_____  c.  Resentment  of  monotonous  routine. 

_____  d.  Resistance  to  something  new. 


* 


. 

I 

■ 


, 
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The  "Flash  Improvement”  illustration  and  discussion  utilised 

in  a Work  Simplification  programs 

a.  Encourages  the  participation  of  the  people  involved. 

b.  Puts  the  "red  light”  on. 

Co  Puts  the  "green  light”  on. 

d.  Makes  for  a more  successful  Work  Simplification  Program. 

e . . . 


« 


( 


PART  111 


Directions*  Below  are  two  columns  of  items.  Match  The  items  j 
in  the  two  columns  by  placing  in  the  answer  space  before  each  j 
item  in  Column  A the  letter  of  the  item  in  Column  B with  which; 
it  is  most  closely  associated, 

— ■>«»»»—  *2  i ■ i ■■  !■■■— — — wwrci  ,n  ■■—n  mi  i»n  — n m ■■  nmmw  n ■ 1 1 — » — a— MHHm-Jjaw  ■mnwinn—il*i  m w— HM—fcJWJCiir  ».  *i 


80,  Column  A 
Directions  for  both  hands 

L,  Hand  R.  Hand 

i.  i t 

. TB>«watv*ar o ^ # ‘■■■II—  '■  ^ 

__  3.  tl  4T 

81.  Column  A 
Symbol 

i.  O 

_ 2-  O 

3.  \7 

■—.... — 4*  C_j 


Column  B 
Description 


a.  Simultaneous 

b.  Simultaneous  and  the  Basse 

c.  Simultaneous  and  Alternate 

d.  Simultaneous  and  Opposite 

e.  Simultaneous  and  Symmetrica? 

Column  B 
Description 

a.  Read  steam  gauge  on  boiler 

b.  Machine  in  use 

c.  Type  letter 

d.  Both  hands  not  idle  at  the 
same  instant 

e.  Employee  waiting  for  elevate 

f.  Finger  and  wrist  motions  use 

g.  Move  material  by  hoist  or 
elevator. 


<0» 


1. 


2. 


3. 

4. 


a.  Normal  Work  Area 

b.  Maximum  Grasp 
e.  Minimum  Grasp 

d.  Normal  Grasp 

e.  Maximum  Work  Area 

f . Minimum  Work  Area 


' 


. 

33*  Hatch  each  of  the  following  guides  In  the  prcedure  of  challenging 

”Make  Ready”  and  51  Put  Away”  details  on  an  Operator  Chart  with  the 
question  in  Column  h with  which  it  is  most  adequately  and  directly 

associated. 


Column  A 
Question 

1.  What? 

2.  Where? 

' 3.  When? 

4.  Who? 

5.  How? 


Column  B 
Guide 

a.  Are  materials  and  tools  located 
within  the  normal  grasp  area? 

b.  Can  there  be  a change  of  person? 

c.  Can  alternate  motions  be  used? 

d.  Can  a drop  delivery  be  used? 

e.  Can  a change  of  location  he  made 
within  the  plant? 

f.  Is  it  necessary? 

g„  Can  a change  of  persons  be  made 
within  the  department? 


> h.  Can  a tool  and  a part  be  picked  up 

in  the  same  trip? 

84„  Match  each  of  the  following  guides  in  the  procedure  of  chal- 
lenging the  ^Do”  details  on  an  Operator  Chart  with  the  question  in 
Column  A with  which  it  is  most  adequately  and  directly  associated. 

Column  A Column  B 

Question  Guide 


1.  What? 

2.  Where? 

3.  When? 

4.  Who? 


a.  Are  hand  motions  replaced  by  foot  and 
mechanical  movements  in  the  ”do”  details? 

b.  Is  it  necessary? 

c.  Are  there  evidences  of  fatigue  in  the 
”don  details? 


5.  How?  d.  Can  the  wdoV5  be  performed  in  a fix- 

ture or  holding  device? 

e.  Is  tlie  wget  ready”  performed  in  the 
most  convenient  location  with  the  ’•do”? 

f.  Are  parts  designed  for  easy  perform- 
ance of  ”do”  details? 

g«  Are  both  hands  performing  ”don 
details? 


h.  Can  the  ndon  be  reversed? 


■ 


. 


Column  A 

Title 


Column  B 

Description 


1.  Flow  Process  Chart 

2.  Flow  Diagram 


a.  j*xi  effective  aid  in  analyzing  work 
in  terms  of  elemental  motions  of  the 
hands  o 


3.  Process  Control 

Layout 

4.  Man  and  Machine 

Chart 

5.  Operator  Chart 

6.  Three  Dimensional 

Layout 


bo  A chart  that  covers  the  complete 
cycles  for  those  members  of  a group  per- 
forming the  smallest  number  of  steps. 

c.  A chart  showing  the  control  of  all 
products  processed  in  the  plant. 

d.  A chart  showing  the  breakdown  of  a 
process  usually  plotted  against  a time 
scale. 


7.  Activity  Chart  e.  A motion  chart  which  shows  most 

readily  how  well  the  operations  of  the 

8.  Siisxo  Chart  hands  are  balanced  and  what  therbligs 

are  used. 


f.  A chart  of  special  value  in  analyz- 
ing all  jobs  with  the  exception  of 
maintenance. 


g.  A composite  of  individual  member 
process  charts  arranged  to  permit 
thorough  analysis. 

h.  One  of  the  best  means  of  recording 
and  later  analyzing  a process  as  a whole. 

i.  Machine,  workbenches,  storage  spaces, 
and  people  made  up  in  scale  models. 

j . Floor  plan  of  a plant  on  which  lines 
are  drawn  to  indicate  the  travel  of  any 
parts  in  question. 

k.  A chart  that  often  suggests  ways  of 
eliminating  idle  machine  time. 

l.  All  punch-press  work  on  all  products 
is  performed  in  a press  department. 


. 


87 . Column  A 

Principles  of  Motion  Economy 


Column  B 

Common  Examples 


1.  Utilize  Momentum  a. 

2.  Use  Gravity  and  Gravity  b. 
Feed  Containers 

3.  Provide  Adjustable  c. 

Tools , Fixtures , Chairs, 
Tables  d. 

4-  Eliminate  Sharp  Changes  e. 
in  Direction 

5.  A Place  for  Everything  f. 
and  Everything  Kept  in 


Its  Place 

g- 

6.  Adequate  Lighting 

7.  Use  Better  Tools  and-  h. 

Machines 

8.  Substitute  Material  i. 

9.  Hesitation  Causes 

10.  Reduce  Distance  and 

Weight  Carried  k. 

11.  Use  Color  1. 

12.  Establish  Rhythm  m. 


n. 

o. 


p. 

q* 

r. 


Foot  pedal  on  water  fountain 

Window  to  right  and  Southern 
daylight 

Pendulum  clock 

Linotype  instead  of  hand  setting 

kitchen  chair  and  kitchen  table 

Fountain  pen,  drop  delivery  mail 
chute  in  office  building 

Dial  telephone,  circular  plowing 
of  farm 

Tools  and  materials  in  minimum 
work  space 

Green  or  grey  on  machines  for 
soothing  effect 

Learning  to  type  with  music 

Wrong  layout,  mislaid  tools 

Drill  stand,  the  rack  for  ties 

Plastics  instead  of  steel  or 
brass 

Windows  to  left  or  behind, 
Northern  day  light 

Tools  and  materials  within  arm* s 
reach,  mechanical  lifting  of 
parts. 

Three  dimensional  color  schemes 
for  machines  for  better  seeing 

Lack  of  sleep,  nervousness 

Barber  chairs 


PART  IV 


Directions?  Number  each  of  the  following  topics  according  | 
to  the  logical  sequence  in  which  you  would  analyze  a plant  \ 
for  improvement  when  using  the  Work  Simplification  approach.!! 
Number  whatever  topic  you  would  perforin,  first  wlw,  the 
second  ”2".  and  so  forth.  J 

88.  Flow  Diagram 

______  89.  Improved  Method  Layout 

______  90.  Operator  Charts 

91.  Micro-Motion  Charts 

_____  92.  Improved  Method  Flow  Process  Charts 

________  93.  Process  Controlled  vs.  Product  Controlled  Analysis 

______  94-  Work  Simplification  Training  Program 

_____  95-  Present  Method  Flow  Process  Charts 

______  96.  Man  Machine  Charts 

_____  97.  Analysis  of  Operator  Charts 

_____  98.  Development  of  the  Improvement  Program 

99.  Micro-Motion  analyses 

_____  100.  Analysis  of  Man  Machine  Charts 

101.  Templet  Layouts  cr  Three  Dimensional  Layouts 

102.  Flow  Process  Chart  Analysis 


. 

. 

. 
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PART  V 


sections*  The  following  are  recommendations  in  applying 
t i 3 Work  Simplification  approach  to  overcome  barriers  of 
re  si stance  when  proposing  changes  in  methods  cf  doing  work. 

E^  -iluate  each  recommendation.  Mark  ”1"  for  a recommendation 
g( lerally  applicable  and  justifiable,  ”2”  if  it  is  sometimes 
sc  ”Q!L i-iLLt 

__  103.  Indirectly  introduce  the  new  idea  so  that  the  person 
accepts  it  as  his  own. 

__  104*  Try  to  show  some  respect  for  the  other  person’s  opinior 

but  tell  him  whenever  he’s  wrong. 

_____  105.  Be  sympathetic  with  the  other  person’s  ideas  even  when 
they  sound  ridiculous. 

_____  106.  Be  a good  listener,  encourage  others  to  talk  about  the 
selves  end  their  work. 

___  107.  Give  clear,  concise  explanations  instead  of  resorting  to 
a questionning  approach. 

. 108.  Call  attention  to  people's  mistakes  indirectly. 

__  109.  If  you  are  wrong,  admit  it  quickly  and  then  give  a full 

explanation  of  why  you  were  at  fault. 

_____  110.  Make  the  worker  feel  important. 

_____  111.  Let  the  other  man  save  his  face. 

_ 112 . Make  sure  you  pronounce  and  write  a worker’s  name 

correctly. 

_____  113.  Keep  the  ”green  light”  on,  in  your  own  mind. 

114»  Objections  of  the  operator  may  be  dismissed  as  unimportan 

_____  115*  When  a foreman  or  operator  realizes  that  Work  Simpiifi 
tlon  is  a part  of  his  duties,  there  will  be  no  questio 
of  his  cooperation. 

_____  116.  Develop  the  ”personalised  approach”. 

______  117.  Remember  the  ’’red  light”  is  on  to  somebody  else’s  idea 

at  the  beginning. 


_ 118.  Apply  the  Golden  Rule  with  intelligent  selfishness”. 

_ 119 o Use  the  wexpert  approach”  whenever  convenient. 

_ 120.  The  average  individual  naturally  likes  changes  in  the 
monotony  of  his  work  routine. 


• • 


121  • Continuity  of  your  suggestions  and  the  force  with  which 

they  are  presented  will  bring  about  the  desired  change . 

122.  If  the  objection  to  a change  is  merely  an  excuse*  it 
need  not  be  considered. 

123-  Size  up  the  worker  and  plan  the  presentation  of  the 
change  accordingly. 

124*  Those  workers  who  honestly  criticize,  or  point  out  wheat 
is  wrong,  are  the  ones  who  help  the  most. 

125.  Classes  to  teach  Work  Simplification  should  be  held  on 
company  property  and  during  working  hours. 

126.  Should  tiie  foreman  or  operator  be  antagonistic  to  an 
improvement  program,  overcome  this  opposition  by  compari 
son  of  his  methods  with  improved  methods  in  use  in 
other  departments. 

127.  Work  Simplification  must  be  presented  to  the  employees 
as  a program  of  mutual  remuneration  and  cooperation. 

128.  The  man  on  the  job,  or  directly  supervising  it,  is  the 
most  qualified  to  improve  it. 

129.  Point  out  that  a major  purpose  of  the  change  is  to  make 
work  easier  for  the  worker. 

130.  Explain  that  the  change  is  not  a ^speed-up**. 

131.  Always  set  up  a test  run  and  try  it  out  before  making  a 
final  decision. 


CHAPTER  III 


ANALYSIS  OF  THE  GROUP  DATA  AND  THE 

INTERPRETATION  OF  THE  STATISTICS  INVOLVED 

The  primary  purpose  of  this  study  was  to  construct 
and  analyze  an  achievement  test  in  Work  Simplification  that 
purported  to  measure  the  progress  attained  at  the  close  of 
the  semester  in  relation  to  the  specific  objectives  of  the 
course.  In  this  study  thirty-nine  college  students  in  three 
classes  of  one  institution  were  tested  by  the  instrument 
under  construction.  These  students  being  seniors  and  graduate 
students  may  be  considered  a selected  group  with  no  great 
differences  in  their  mental  abilities.  The  summarized  results 
of  the  total  scores,  their  comparisons  with  the  subjective 
examination  testing  the  same  learning  outcomes  and  also  with 
the  final  grade  in  the  course  are  considered  and  interpreted 
first. 

Data  collected  from  tests  and  experiments  often 
have  little  meaning  or  significance  until  they  have  been 
classified  in  a systematic  way.  The  tabulation  of  the  three 
groups  of  scores  within  their  class  intervals  in  a frequency 
distribution  follows. 
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TABLE  I 

FREQUENCY  DISTRIBUTIONS  OF  OBJECTIVE  TEST, 

SUBJECTIVE  TEST,  AND  FINAL  TERM  MARKS 
IN  WORK  SIMPLIFI CATION 

OBJECTIVE  TEST  SUBJECTIVE  TEST  TERM  MARKS 

Scores  Frequencies  Scores  Frequencies  Scores  Frequencies 

190-194 

1 

94-95 

2 

94-95 

1 

- 

185-189 

0 

92-93 

0 

92-93 

3 

180-184 

0 

90-91 

1 

90-91 

3 

175-179 

3 

88-89 

2 

88-89 

1 

170-174 

5 

86-87 

4 

86-87 

5 

165-169 

1 

84-85 

0 

84-85 

4 

160-164 

6 

82-83 

1 

82-83 

6 

It 

155-159 

7 

80-81 

3 

80-81 

4 

150-154 

5 

78-79 

5 

78-79 

1 

145-149 

4 

76-77 

1 

76-77 

3 

140-144 

4 

74-75 

4 

74-75 

1 

135-139 

1 

72-73 

3 

72-73 

6 

130-134 

2 

70-71 

4 

70-71 

1 

68-69 

5 

N 

= 39 

N 

= 39 

66-67 

0 

64-65 

3 

62-63 

1 

N = 

39 
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Use  of  Normal  Percentile  Chart 


Aid  in  analyzing  numerical  data  may  often  be  ob- 
tained from  a graphic  treatment  of  the  frequency  distributions 
which  seeks  to  translate  numerical  facts  into  more  concrete 
and  understandable  form.  For  this  purpose  the  Normal  Percen- 
tile Chart  was  considered  most  desirable  for  use  in  the  study: 

1.  to  discover  the  peculiar  characteristics  of  the  dis- 
tributions as  to  normality  and  skewness. 

2.  to  compare  quickly  and  easily  the  characteristic  ten- 
dencies of  the  three  groups  of  scores. 

3.  to  obtain  the  median  of  each  variable. 

4.  to  obtain  the  standard  deviation  of  each  variable . 

5.  to  obtain  percentiles  for  the  objective  test. 

6.  to  assign  letter  ratings  to  students. 

In  presenting  these  three  distributions  graphically, 
the  general  procedure  in  drawing  a percentile  curve  was 
followed:  * 

1.  Distributing  the  scores. 

2.  Finding  the  sub-total  number  of  sub -cases  to  and  in- 
cluding those  in  each  interval  of  score. 

3.  Reducing  these  sub-totals  to  percents. 

4.  Locating  points  on  the  chart  representing  these  percents. 

3.  Drawing  a smooth  curve  through  these  points. 


* Arthur  S.  Otis,  Normal  Percentile  Chart,  Manual  of 
Directions , ( World  Book  Company,  N.Y.,  1938,  p . 3 - ) 
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CHART  II 

GRAPHIC  PRESENTATION  OF  THE  THREE  GROUPS 
OF  SCORES  ON  THE  NORMAL  PERCENTILE  CHART 


L J 


Interpretation  of  the  Percentile  Curves,  Skewness 

The  Normal  Percentile  Chart  with  the  percentile 
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scales  at  the  top  and  bottom  is  so  constructed  that  when  a 
normal  distribution  is  plotted,  what  was  formerly  a "percentile 
curve"  becomes  a straight  line.  However,  in  order  to  draw  a 
smooth  line  through  the  points  plotted,  it  is  often  necessary 


to  miss  certain  of  the  dots  by  small  amounts.  An  attempt 
was  made  in  drawing  each  curve  to  let  the  dots  missed  above 
the  line  approximately  balance  those  missed  below  the  line. 

The  first  thing  that  strikes  the  eye  is  the  symmetry 
or  lack  of  symmetry  in  the  groups  of  scores  plotted.  The  scor 
on  the  objective  examination  present  a straight  line  without 
much  difficulty,  although  there  is  some  negative  skewness 
where  there  is  an  accumulation  of  more  scores  at  the  right 
end  than  at  the  left.  If  lines  were  drawn  joining  each  pair 
of  consecutive  dots  on  the  chart  preserving  all  the  irregu- 
larities of  the  distributions,  the  three  percentile  lines 
would  all  have  the  same  general  shape , and  may  be  considered 
symmetrical,  with  each  having  scores  piled  up  at  the  high 
end  of  the  scale.  However,  the  percentile  curves  of  the 
subjective  scores  and  final  term  marks  are  much  more  signi- 
ficantly skewed  to  the  left  so  that  the  smooth  lines  through 
their  dots  take  the  fonns  of  definite  curves,  of  which  the 
percentile  line  of  the  subjective  examination  presents  the 
higher  degree  of  skewness  where  the  mean,  median,  and  mode 
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will  vary  more  in  the  distribution.  On  the  other  hand,  the 
percentile  line  of  the  objective  examination  being  more  nearly 
a straight  line  indicates  a presumably  normal  distribution 
in  which  there  will  be  little  difference  in  the  mean,  median, 
and  mode. 

The  scores  on  the  subjective  examination  run  con- 
sistently above  the  line  of  objective  scores,  which  indicates 
that  this  test  was  easier  for  the  students  than  the  objective 
test.  It  is  clear  from  the  chart  that  there  are  small  dif- 
ferences between  the  objective  test  scores  and  the  subjective 
scores  at  the  low  end  of  the  scale , but  that  the  differences 
become  greater  at  the  top  range.  A comparison  of  the  per- 
centile curves  of  the  subjective  examination  and  the  final 
grades  shows  a greater  difference  at  the  lower  range,  which 
decreases  until  there  is  overlapping  at  the  right  end  of  the 
scale.  Indications  are  that  the  test  scores  and-  final  grades 
are  high  in  this  group,  and  that  there  is  greater  correspon- 
dence between  the  scores  on  the  subjective  examination  and  the 
final  mark  than  between  the  scores  of  the  objective  examination 
and  the  final  mark. 

The  characteristic  of  the  percentile  lines  to  be 
negatively  skewed  is  not  surprising,  for  college  seniors  and 
graduate  students  represent  a selected  group,  and  the  sample 
tested  is  only  39  and  small  in  number.  Garrett  presents  un- 
representative or  biased  sampling  as  his  first  common  cause 
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of  asymmetry. *  * ”A  small  sample  is  not  necessarily  unrepre- 
sentative, but  more  often  than  not  it  is  apt  to  be.”  As  for 
selection,  he  states,  **"Selection  will  produce  skewness  and 
kurtosis  in  distributions  even  when  the  test  has  been  ade- 
quately constructed  and  carefully  administered.”  Ross  makes 
this  assertion  as  to  skewness,  ***  ”In  classes  for  which  there 
is  satisfactory  evidence  as  to  their  non-typical  character, 
skewed  distributions  may  be  regarded  as  normal  for  those  par- 
ticular classes” . 

Medians  and  Standard  Deviations  of  the  Three  Groups  of  Scores 
A more  detailed  analysis  of  these  three  groups  of 
scores  is  revealed  in  a comparison  of  certain  points  in  the 
distribution.  The  comparison  which  is  natural  to  make  first 
is  the  comparison  of  the  medians . By  determining  the  point 
where  each  percentile  curve  cuts  the  heavy  vertical  50-per- 
centile line  on  the  chart,  the  median  score  of  a group  of 
scores  is  found.  The  point  of  intersection  is  interpreted 
in  the  light  of  the  score  intervals  that  have  been  written 
in  the  score  interval  column  at  the  left  pertaining  to  the 


* Henry  E . Garrett,  Statistics  in  Psychology  and  Education, 
(Longmans,  Green  & Company,  N.Y.,  1947,  pTl27.) 

**  Ibid . 

***  Ross,  op.  cit.,  p.170. 
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percentile  curve  in  question.  The  median  score  of  the  ob- 
jective test  with  the  score  interval  of  5 is  found  to  be  157; 
the  subjective  test  with  the  score  interval  of  2 has  75  as  a 
median,  and  the  term  grade  with  the  score  interval  of  2 has  a 
median  of  83. 5 . 

The  inference  may  be  drawn  at  this  point  that  a score 
of  157  in  the  objective  examination  corresponds  to  a score  of 
75  in  the  subjective  examination,  and  to  the  grade  of  83.5  on 
the  final  mark;  and  that,  theoretically,  the  score  of  157  in 
the  objective  examination  represents  the  same  degree  of 
achievement  as  the  score  of  75  in  the  subjective  examination, 
and  as  the  mark  of  83.5  on  the  final  grade. 

It  must  be  remembered  that  * "The  value  of  the 

W) 

median  found  from  a percentile  curve  in  this  fashion  may  not 
be  exactly  the  same  as  the  median  found  in  the  usual  way  by 
counting  to  the  middle  paper  in  order  of  score;  but  the 
median  score  found  by  means  of  the  curve  is  considered  to 
represent  the  distribution  better  than  the  actual  middle 
score,  which  we  might  call  the  accidental  median,  and  for  that 
reason  it  is  considered  preferable." 

The  median,  a measure  of  central  tendency,  describes 
only  one  characteristic  of  the  data,  the  tendency  of  the  scores 
to  pile  up  or  near  the  middle  of  the  distribution.  Descriptions 
of  these  groups  of  scores,  to  be  meaningful,  must  include  the 

fc  * Otis,  op.  cit.,  pp.4>5. 
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degree  to  which  the  scores  are  scattered  out.  The  standard 
deviation  is  the  measure  of  variability  customarily  employed 
in  research.  The  SD  is  technically  defined  as  the  square 
root  of  the  average  of  the  squares  of  the  deviations  from  the 
mean.  Using  the  standard  deviation  scale  of  the  normal  per- 
centile chart,  the  SD  may  be  computed  as  that  range  of  scores 
between  the  median  score  and  the  84th  percentile  score,  or 
that  range  of  scores  between  the  median  and  the  16th  percen- 
tile score  when  the  distribution  is  normal.  *In  this  in- 
stance, where  the  distributions  are  skewed,  the  two  values 
of  the  SD  described  above  will  not  come  out  the  same , so  a 
single  measure  of  the  variability  of  scores  is  obtained  by 
taking  the  average  of  these  two  values  as  the  standard  de- 
viation of  the  distribution.  Following  this  procedure,  the 
standard  deviations  are  found  to  be: 


GROUP  SCORES 

Objective  Test 
Subjective  Test 
Final  Grades 


STANDARD  deviation 

14 

9.25 

8.5 


It  is  evident  that  the  objective  test  has  the  great- 
est variability,  exceeding  that  of  the  subjective  test  by  4*75 
and  that  of  the  final  grade  by  5*50.  There  is  correspondence 
in  the  variabilities  of  the  subjective  test  and  the  final 
grades  where  the  SD  difference  is  only  .75.  The  objective  test, 
being  a longer  instrument  providing  for  greater  sampling  of  the 


* Otis,  op.  cit.,  p.5. 
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materials  in  the  course,  would  be  expected  to  show  greater 
variability. 

The  Interpretation  of  Test  Results  for  Class  Use 

Granted  that  the  objective  test  in  Work  Simplifi- 
cation has  the  validity  characteristic  of  a satisfactory 
measuring  ins trument , the  scores  should  then  be  carefully 
analyzed  for  class  use . The  first  steps  in  the  analysis  of 
the  objective  test  results  for  class  use  have  been  discussed 
earlier  in  the  comparison  of  the  three  variables,  objective 
test  scores,  subjective  test  scores,  and  the  final  grade  marks 
The  frequency  distribution  of  the  objective  test  has  been 
presented,  and  the  percentage  cumulative  frequency  distri- 
bution is  found  on  the  Normal  Percentile  Chart,  where  the 
distribution  was  plotted,  and  the  median  determined  as  157 
and  the  SD  as  14 . It  was  noticed  that  the  percentile  curve 
for  the  test  takes  the  shape  of  a straight  line  when  smoothed 
but  has,  nevertheless,  when  maintaining  the  irregularities  of 
the  distribution  itself,  a negative  skev/ness  indicating  that 
the  test  was  a little  easy  for  the  group  tested.  The  im- 
plications for  instruction  may  be  that  many  of  the  students 
have  mastered  much  of  the  materials  presented  in  the  course, 
and  that  the  objectives  of  the  course  have  been  largely  met. 

With  the  papers  scored  and  the  graphic  presentation 
of  the  distribution  interpreted,  what  will  the  procedure  be 
for  the  assigning  of  letter  ratings  to  the  students  on  the 
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basis  of  the  scores  made  in  the  test?  Again,  by  referring  to 
the  Normal  Percentile  Chart,  where  the  distribution  is  plotted, 
the  letter  ratings  can  be  easily  and  adequately  assigned. 

Since  it  is  desired  to  give  5 letter  ratings,  H,  C,  P,  L, 
and  F to  scores  made  by  the  students,  the  distribution  must 
be  divided  into  approximately  five  equal  intervals  of  score. 
Upon  examining  the  SD  scale  at  the  bottom  of  the  chart , it 
is  discovered  that  each  sigma  unit  equals  two  inches.  By 
locating  the  median,  and  by  allowing  one  inch  on  either  side 
of  it,  we  have  a unit  of  one  standard  deviation  into  which 
the  scores  of  the  middle  group  to  be  assigned  the  letter  P 
will  fall.  Upon  dividing  the  rest  of  the  scale  to  the  right 
and  to  the  left  of  this  middle  group  into  units  of  one 
standard  deviation,  we  have  five  equal  intervals  on  the  stan- 
dard deviation  scale  for  the  purpose  of  assigning  the  letter 
grades.  Thus,  scores  exceeding  7^1.5  3D  on  the  scale  will  be 
given  the  letter  rating  H,  scores  falling  between  -/l. 5 SD  and 
7^.5  SD  rate  C,  and  the  middle  group  between  7^.5  SD  and  -5  3D, 
as  was  determined,  is  P.  Within  the  interval  -.5  SD  and 
-1.5  SD  fall  the  scores  rating  L,  and  withi n the  limits  of 
-1.5  SD  and  -2.5  SD  are  found  the  lowest  scores,  whose  letter 
rating  is  F.  A chart  assigning  letter  ratings  to  the  specific 
score  intervals  by  use  of  this  method  immediately  follows. 
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TABLE  III 


TABLE  SHOWING  LETTER  RATINGS 
ASSIGNED  TO  OBJECTIVE  TEST  SCORES  IN 
WORK  SIMPLIFICATION 


SD  INTERVAL  SCORES  LETTER  RATING 


7*2.5 

to 

7*1.5 

178  - 

- 194 

H 

-/l. 5 

to 

7*  .5 

164  • 

- 178 

C 

¥ .5 

to 

- .5 

150  - 

- 164 

P 

- .5 

to 

-1.5 

137  - 

- 150 

L 

-1.5 

to 

-2.5 

137  ■ 

- 133 

F 
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rinding  Percentile  Scores  by  Means  of  the  Percentile  Curve 

Peatman  gives  a clear-cut  and  concise  explanation 
of  the  nature  and  the  purpose  of  the  percentile  method  for 
variate  data.  In  writing  about  percentiles,  he  has  ab- 
breviated the  term  to  centiles  for  the  sake  of  simplicity  and 
of  consistency  with  other  commonly  used  measures  which  are 
based  on  the  centile  method.  *”a  centile  point  is  a value  on 
the  score  scale  of  a variable  such  that  a given  percentage 
of  the  frequencies  of  the  distribution  lies  above  the  given 
point  value,  and  the  remaining  percentage  of  the  frequencies 
lies  below  the  given  point  value,  a complete  scale  of  centile 
values  divides  a distribution  of  frequencies  into  100  equal 
parts,  so  that  the  total  frequencies  are  divided  into  suc- 
cessive gioups,  each  of  which  includes  Vjo  of  all  the  fre- 
quencies. A centile  point  of  value  means  exactly  what  it 
says,  viz.  that  a certain  percentage  of  the  frequencies  is 
located  in  the  distribution  above  the  given  centile  value, 
the  remaining  frequencies  below.  Thus,  the  3 3rd  percentile  of 
a distribution  is  always  a value  on  the  scale  of  measures 
such  that  67 % of  the  frequencies  are  above  this  value,  and 
33$  are  below.” 

In  a further  discussion  of  the  percentile  method, 
Peatman  states,  **  "The  centile  method  is  a particularly  valuable 

* John  G-ray  Peatman , Descriptive  and  Sampling  Statistics 
(Harper  and  Brothers,  N.Y. , 1947,  p.l27«) 

**  Peatman,  op.  cit.,  p.127. 
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statistical  technique  because  the  basic  interpretation  of 
centile  measures  is  not  limited  by  the  form  of  the  distri- 
bution” . 

Peatman  also  explains  that  the  basic  assumption  in 
using  the  percentile  method  for  describing  the  distribution 
of  a variable  * "is  that  the  measures  or  scores  of  the  dis- 
tribution form  a continuous  series.  This  assumption,  as  v/e 
have  seen,  is  inherent  in  the  definition  of  a variable;  that 
is,  a variable  yields  a continuous  series  of  measures  ranging 
from  least  to  most." 

On  the  matter  of  determining  the  percentile  values 
Peatman  states  **  "In  practice,  two  methods  are  used  for 
► deteimining  any  centile  value  of  a distribution.  One  is 

computational;  the  other  graphic.  Both  provide  centile  point 
values  from  which  the  ranges  of  centile  intervals  and  other 
measures  derived  from  centiles  can  be  determined.  For  most 
practical  purposes,  the  graphic  method  is  as  satisfactory  as 
the  computational  method." 

In  using  the  Normal  Percentile  Chart,  the  percentile 
score  is  found  in  exactly  the  same  way  as  the  median  (which 
is  in  reality  the  50th  percentile),  except  that  the  percentile 
whose  value  is  sought  is  the  one  located  on  the  bottom  of  the 
scale.  With  this  as  a starting  point,  the  score  value  of  the 


* Ibid,  p.127. 

**  Peatman,  op.  cit.,  p,135« 
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given  percentile  is  obtained  from  locating  the  point  where 
the  percentile  curve  cuts  the  percentile  line.  This  point 
of  intersection  is  then  interpreted  in  the  light  of  the  score 
intervals  that  have  been  written  in  the  score -interval  column 
which,  in  this  case,  is  five.  Following  this  procedure,  a 
table  of  percentiles  for  each  point  of  score  in  the  objective 
test  is  presented. 
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TABLE  IV 


PERCENTILES  FOR  EACH  POINT  OF  SCORE  ON 
OBJECTIVE  EXAMINATION  READ  FROM  NORMAL  PERCENTILE  CHART 


Test  Score 

Percentile 

Test  Score 

Percentile 

129 

2.2 

162 

65. 

130 

2.6 

163 

67.5 

131 

3. 

164 

70. 

132 

3.3 

163 

72.9 

133 

4.2 

166 

75. 

134 

3. 

167 

77. 

133 

3.6 

168 

79.5 

136 

6.5 

169 

81.5 

137 

7.3 

170 

83.5 

138 

8.4 

171 

85. 

139 

9.7 

172 

86.8 

140 

11. 

173 

88.2 

141 

12.1 

174 

89.7 

142 

13.9 

175 

91.0 

143 

13.3 

176 

92. 

144 

17.2 

177 

93. 

143 

19.3 

178 

94. 

146 

21.3 

179 

94.9 

147 

23.9 

180 

95.6 

148 

26. 

181 

96.3 

149 

48.2 

182 

96.8 

150 

31. 

183 

97.3 

151 

33.3 

I84 

97.7 

132 

36. 

185 

98.1 

133 

39. 

186 

98.2 

154 

41.3 

187 

98.6 

133 

44.3 

188 

93.9 

136 

48  • 

189 

99.1 

137 

30.2 

190 

99.3 

138 

33.5 

191 

99.4 

139 

56.5 

192 

99.5 

160 

59. 

193 

99.6 

161 

62. 

194 

99.7 

S\  J 
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Reliability 

Perhaps  the  most  widely  used  method  for  estimating 
the  reliability  of  tests  is  the  split-half  technique  which 
was  selected  for  use  in  this  study.  The  objective  test  was 
divided  into  "chance  halves”  by  computing  one  score  for  even- 
numbered  items  and  another  score  for  odd-numbered  items. 

When  the  two  series  of  scores  were  obtained,  the  coefficient 
of  correlation  between  them,  employing  the  Pearson-product 
moment  formula,  was  computed  by  use  of  the  * Durost-Walker 
Correlation  Chart.  The  Durost-Walker  Correlation  Chart  is 
designed  to  check  on  the  arithmetical  processes  at  frequent 
intervals  in  the  course  of  the  computation  of  the  Pearson- 
product  moment  coefficient  of  correlation,  and  also  provides 
for  two  independent  derivations  of  the  coefficient  furnishing 
a valuable  check  throughout  the  process.  The  reliability  of 
the  half  test  thus  determined  was  .71.  The  reliability  of  the 
whole  test  was  then  computed  by  application  of  the  Spearman 
Brown  Prophecy  formula,  which  is  ** 

r s 

12  T7ii 


where  rjg  is  the  correlation  between  scores  on  the  "chance- 
halves"  of  the  test  and  rl2  is  the  estimated  reliability  for 


* Walter  N.  Durost,  Helen  M.  Walker,  Durost-Walker  Correla- 
tion Chart,  (World  Book  Company,  N.Y. , 1937. ) 

**  Harry  A.  Greene,  A.  N.  Jorgensen,  J.  Raymond  Gerberich, 

Measurement  and  Evaluation  in  the  Secondary  School,  (Long- 
man, Green  & Company,  N.Y. , 1948,  p.590.) 
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the  entire  test.  The  estimated  reliability  of  the  whole  test 
was  found  to  be  .83  which,  the  writer  feels,  is  sufficiently 
significant  to  consider  the  test  a reliable  instrument  for 
this  purpose  and  this  group. 


Correlations  with  Subjective  Test  and  Final  Marks 


The  Durost -Walker  Charts  for  computing  a coefficient 
of  correlation  by  the  Pearson-product  moment  method  were  used 
to  express  the  relationship  of  two  variables  in  a single 
objective  or  mathematical  value.  Using  this  procedure,  the 
correlation  between  the  objective  examination  and  subjective 
examination  was  found  to  be  .39,  which  is  a very  low  validity 
coefficient  statistically.  The  low  correlation  may  be 
explained  by  the  following  factors  involved: 

1.  The  scores  on  the  subjective  examinations  represent 
three  different  subjective  tests. 

2.  The  reliability  and  validity  of  the  subjective  tests 
have  not  been  determined. 

3.  It  is  not  known  to  what  degree  the  grading  by  the 
three  instructors  was  objective  or  consistent. 

4.  By  the  very  procedure  in  construction,  eacfo  sub- 
jective examination  sampled  a different  area  of 
instruction  from  that  included  in  the  others. 

3.  The  longer  objective  instrument  sampled  all  the 
important  areas  of  instruction,  and  was  measuring 
differently  and  beyond  the  area  of  each  subjective 
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instrument . 

6.  If  the  subjective  tests  are  not  valid,  then  the 
validity  coefficient  between  them  and  a valid  in- 
strument would  naturally  be  lew'  statistically. 

The  Pearson -product  moment  coefficient  of  correla- 
tion between  the  objective  test  and  the  final  grade  was  re- 
vealed as  .47,  while  that  of  the  subjective  test  and  the 
final  grades  was  computed  as  .56.  Since  the  subjective  ex- 
amination entered  as  one  of  the  primary  elements  in  the  final 
term  mark,  whereas  the  objective  test  did  not  enter  at  all, 
the  higher  correlation  of  the  subjective  examination  with 
the  final  marks  is  easily  accounted  for.  It  is  interesting 
to  note  that  the  correlation  of  .56' between  the  subjective 
tests  and  the  final  grades  indicates  that  other  factors  such 
as  term  papers  and  laboratory  problems  also  figured  signi- 
ficantly in  the  determination  of  the  final  grades  of  the 
group . 
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CHAPTER  IV 


INDIVIDUAL  ITEM'  ANALYSIS 


Method  Employed 

An  analysis  of  the  test  items  and  the  distractors 
was  made  individually  to  denote  the  differentiating  capacity 
or  discriminatory  paver  of  each  item,  as  well  as  the  relative 
difficulty  of  each  item  and  distractor  in  the  test. 

* Helen  M.  Walker fs  Method  of  Item  Validation  by 
Sequential  Selection  was  employed  for  the  above  purposes  be- 
cause of  its  suitability  for  use  in  situations  where  the  num- 
ber of  cases  is  small.  Walker1 s technique  has  been  followed 
for  all  items  and  distractors  in  the  test,  with  the  exception 
of  Part  IV,  the  rearrangement  item,  which  is  not  adapted  to 
this  type  of  analysis  and  will  be  treated  later  in  this  chap- 
ter. 

The  following  is  a description  of  the  step-by-step 
procedure  used: 

1.  Computing  the  total  number  of  correct  answers  for  each 
item  and  distractor. 

2.  Computing  the  percent  passing  each  item  correctly. 

**Holzinger * **s  statistical  tables  were  used  for  the  percents. 

* Helen  M.  Walker,  "Item  Selection  by  Sequential  Sampling," 
Teachers*  College  Record,  50,  Number  6,  March,  1949* 

**  Karl  J.  Holzinger , Statistical  Tables  for  Students  in  Edu- 
cation  and  Psychology , (University  of  Chicago  Press , Chicago , 
1931.) 
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Selecting  the  ten  top  and  the  ten  bottom  scores  as 
a differentiating  basis. 

Counting  the  number  of  failures  for  each  item  and  dis- 
tractor.  A failure  was  considered  as  any  instance 
where  an  item  was  not  passed  by  the  top  ten,  or  was 
passed  by  the  bottom  ten. 

Entering  the  appropriate  table  prepared  by  Dr.  Walker, 
as  determined  by  the  item  difficulty  or  percent  passing 
the  item  correctly.  N,  in  every  case,  was  ten  and  R was 
the  total  number  of  failures. 

Designating  the  item  as  P,  Pass,  Q,  Questionable,  or 
R,  Reject,  depending  upon  the  location  of  the  inter- 
section of  the  row  and  the  column  identified  by  N and  R. 
Locating  the  values  of  the  items  passing  or  questionable 
as  designated  by  the  tables.  The  value  in  each  case 
presents  the  number  of  chances  in  100  that  the  indicated 

failures  would  occur  by  the  operation  of  chance  alone 
out  of  a total  possibility;  of  twenty  failures.  Only 
those  items  in  the  Passing  and  Questionable  ranges  are 
given  their  respective  values,  as  determined  by  the 
tables  used. 
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TABLE  V 
PART  I 

INDIVIDUAL  ITEM  ANALYSIS 

METHOD  OF  ITEM  VALIDATION  BY  SEQUENTIAL  SELECTION 


No  .of 
Item 

Total 

Correct 

Percent  Passing 
Item  Correctly 

R-Total  No. 
of  Failures 

Value 

P,  Q or  R 

1 

34 

87 

6 

.02 

P 

2 

36 

92 

8 

.12 

Q. 

3 

39 

100 

10 

R 

4 

37 

95 

9 

.12 

Q, 

5 

29 

74 

8 

R 

6 

36 

92 

11 

R 

7 

36 

92 

8 

.12 

Q 

8 

36 

92 

9 

R 

9 

38 

97 

9 

R 

10 

38 

97 

R 

11 

38 

97 

R 

12 

23 

59 

7 

.07 

Q. 

13 

6 

15 

9 

R 

14 

26 

67 

9 

R 

13 

30 

77 

7 

.07 

Q, 

16 

22 

56 

11 

R 

17 

39 

100 

10 

R 

18 

39 

100 

10 

R 

19 

33 

85 

11 

R 

20 

30 

77 

8 

R 

21 

36 

92 

8 

.12 

Q, 

22 

38 

97 

10 

R 

23 

21 

54 

6 

.04 

P 

24 

13 

33 

6 

.03 

P 

23 

32 

82 

11 

R 

26 

20 

51 

10 

R 

27 

28 

72 

9 

R 

28 

23 

59 

4 

.01 

P 

29 

22 

56 

11 

R 

30 

39 

100 

10 

R 

31 

35 

90 

12 

R 

32 

32 

82 

8 

.12 

Q, 

33 

21 

54 

8 

R 

34 

39 

100 

10 

R 

35 

21 

54 

12 

R 

36 

26 

67 

8 

R 

37 

18 

46 

10 

R 

38 

19 

49 

5 

.01 

P 
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TABLE  V 
PART  I 
(continued) 


No  .of 
Item 

Total 

Correct 

Percent  Passing 
Item  Correctly 

Total  No. 
of  Failures 

Value 

39 

22 

56 

10 

40 

20 

51 

4 

.01 

41 

14 

36 

5 

.01 

42 

33 

85 

8 

.12 

43 

38 

97 

9 

44 

34 

87 

8 

.12 

45 

22 

56 

10 

46 

39 

100 

10 

47 

18 

46 

6 

.07 

,0,  or  R 
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TABLE  V 
PART  II 


No.  of 
Item 

Total 

Correct 

Percent  Passing 
Item  Correctly 

Total  No. 
of  Failures 

Value 

48a 

32 

82 

7 

.05 

b 

37 

95 

11 

c 

20 

51 

6 

.04 

d 

26 

66 

8 

49a 

31 

79 

10 

b 

23 

59 

8 

c 

36 

92 

10 

d 

38 

97 

10 

50a 

36 

92 

10 

b 

36 

92 

7 

.05 

c 

33 

48 

11 

d 

11 

28 

10 

51a 

12 

31 

7 

.07 

b 

27 

69 

13 

c 

38 

97 

10 

d 

38 

72 

8 

52a 

34 

87 

8 

.12 

b 

36 

92 

10 

c 

35 

89 

10 

d 

29 

74 

10 

53a 

36 

92 

0 

b 

31 

79 

10 

c 

27 

72 

5 

.01 

d 

27 

72 

10 

54a 

35 

89 

10 

b 

34 

87 

13 

c 

9 

23 

6 

.02 

d 

29 

74 

7 

.07 

55a 

39 

100 

10 

b 

38 

97 

9 

c 

39 

100 

10 

d 

39 

100 

10 

56a 

21 

54 

13 

b 

37 

95 

8 

.12 

c 

37 

95 

9 

d 

39 

100 

10 

57a 

38 

97 

11 

b 

31 

79 

11 

c 

32 

82 

6 

.02 

d 

34 

87 

8 

.12 
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TABLE  V 
PART  II 
(continued ) 


No.  of 
Item 

Total 

Correct 

Percent  Passing 
Item  Correctly 

Total  No. 
of  Failures 

Value 

p,ft 

58a 

38 

97 

10 

R 

b 

35 

89 

10 

R 

c 

30 

77 

14 

R 

d 

33 

84 

9 

R 

59a 

35 

89 

7 

.05 

P 

b 

33 

84 

10 

R 

c 

27 

69 

6 

.04 

P 

d 

36 

92 

9 

R 

60a 

37 

95 

10 

R 

b 

24 

62 

11 

R 

c 

38 

97 

10 

R 

d 

36 

92 

7 

.05 

P 

6la 

13 

33 

8 

.07 

ft 

b 

29 

74 

9 

R 

c 

32 

82 

8 

.12 

ft 

d 

22 

56 

7 

.07 

ft 

e 

22 

56 

6 

.04 

P 

62a 

29 

74 

11 

R 

b 

33 

84 

9 

R 

c 

31 

79 

8 

R 

d 

30 

77 

9 

R 

63a 

36 

92 

8 

.12 

ft 

b 

34 

62 

7 

.07 

ft 

c 

37 

95 

8 

.12 

ft 

d 

36 

92 

8 

.12 

ft 

e 

36 

92 

10 

R 

f 

34 

87 

7 

.05 

P 

64a 

39 

100 

10 

R 

b 

39 

100 

10 

R 

c 

39 

100 

10 

R 

d 

38 

97 

10 

R 

e 

36 

92 

8 

.12 

ft 

f 

33 

84 

8 

.12 

ft 

S 

39 

100 

10 

R 

h 

38 

97 

9 

R 

• 

l 

35 

89 

9 

R 

j 

21 

54 

8 

.12 

ft 

k 

38 

97 

9 

R 

1 

38 

97 

9 

R 
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TABLE  V 

PART  II 

(continued ) 

t 

No.  of 

Total 

Percent  Passing  Total  No. 

Item 

Correct 

Item  Correctly  of 

Failures 

Value 

P.Q,  or  R 

65a 

37 

93 

10 

R 

b 

11 

28 

9 

R 

c 

20 

31 

10 

R 

d 

31 

79 

8 

R 

e 

37 

93 

8 

.12 

Q, 

f 

15 

38 

8 

R 

g 

36 

92 

11 

R 

h 

37 

93 

11 

R 

i 

24 

62 

8 

R 

J 

33 

89 

10 

R 

k 

31 

79 

11 

R 

66a 

37 

93 

8 

.12 

Q, 

b 

34 

62 

8 

R 

c 

36 

92 

11 

R 

d 

36 

92 

9 

R 

67a 

38 

97 

10 

R 

b 

33 

89 

12 

R 

c 

37 

93 

10 

R 

) 

d 

39 

100 

10 

R 

68a 

11 

28 

10 

R 

b 

31 

79 

10 

R 

c 

7 

18 

9 

R 

d 

37 

95 

9 

R 

69a 

32 

82 

10 

R 

b 

71 

44 

6 

.04 

P 

c 

38 

97 

9 

R 

d 

30 

77 

7 

.07 

Q, 

70a 

33 

89 

9 

R 

b 

32 

82 

6 

.02 

P 

c 

36 

92 

10 

R 

d 

24 

62 

10 

R 

71a 

38 

97 

10 

R 

b 

36 

92 

9 

R 

c 

38 

97 

9 

R 

d 

37 

95 

8 

.12 

Q, 

72a 

21 

54 

5 

.01 

p 

b 

39 

100 

10 

R 

c 

39 

100 

10 

R 

d 

37 

95 

9 

R 

73a 

39 

100 

10 

R 

b 

29 

74 

13 

R 

c 

17 

43 

9 

R 

b 

d 

20 

51 

9 

R 
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TABLE  V 
PART  II 
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( continued ) 


> 


No.  of 
Item 

Total 
Corre  ct 

Percent  Passing 
Item  Correctly 

Total  No. 
Of  Failures 

Value 

P»Q.  or 

74a 

34 

87 

9 

R 

b 

21 

54 

7 

.07 

Q, 

c 

11 

28 

7 

.05 

P 

d 

24 

62 

6 

.04 

P 

75a 

29 

74 

10 

R 

b 

23 

59 

10 

R 

c 

27 

69 

9 

R 

d 

32 

82 

10 

R 

e 

35 

89 

8 

.12 

Q 

f 

38 

97 

10 

R 

76a 

37 

95 

8 

.12 

Q, 

b 

34 

87 

6 

.02 

P 

c 

39 

100 

10 

R 

d 

39 

100 

10 

R 

77a 

38 

92 

9 

R 

b 

c 

d 

38 

U 

97 

8 

10 

8 

9 

.12 

R 

78a 

23 

59 

5 

.01 

P 

b 

34 

87 

8 

.12 

Q, 

c 

36 

92 

10 

• 

R 

d 

39 

100 

10 

R 

79a 

22 

56 

10 

R 

b 

36 

92 

9 

R 

c 

21 

54 

10 

R 

d 

17 

34 

3 

.01 

P 

- 
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No. of 
Item 

Total 

Correct 

TABLE 

PART 

Percent 
Passing  Item 

V 

III 

Total  No. 
of  Failures 

Value 

P.Q  or  R 

80(1) 

11 

28 

11 

R 

(2) 

12 

31 

12 

R 

(3) 

7 

18 

12 

R 

81  1 

32 

82 

12 

R 

(2) 

34 

87 

11 

R 

(3) 

34 

87 

10 

R 

(4) 

32 

82 

9 

R 

82(1) 

34 

87 

9 

R 

(2) 

31 

79 

8 

R 

(3) 

34 

87 

6 

.02 

P 

(4) 

30 

77 

7 

.07 

ft 

83(1) 

38 

97 

9 

R 

(2) 

28 

72 

8 

R 

(3) 

32 

82 

7 

.05 

P 

(4) 

37 

95 

10 

R 

(5) 

20 

51 

9 

R 

84(1) 

38 

97 

9 

•R 

(2) 

18 

46 

12 

R 

(3) 

27 

69 

7 

.07 

ft 

(4) 

13 

33 

11 

R 

(5) 

7 

18 

8 

.12 

ft 

85(1) 

35 

89 

9 

R 

(2) 

36 

92 

10 

R 

(3) 

32 

82 

6 

.02 

P 

(4) 

30 

77 

6 

.03 

P 

(5) 

25 

64 

8 

.04 

P 

(6) 

37 

95 

8 

.12 

ft 

(7) 

6 

15 

8 

R 

(8) 

13 

33 

5 

.01 

P 

86(1) 

32 

82 

5 

.01 

P 

(2) 

30 

77 

7 

.07 

ft 

(3) 

14 

36 

7 

.07 

ft 

(4) 

14 

36 

4 

.01 

P 

(5) 

20 

51 

6 

.02 

P 

(6) 

22 

56 

7 

.04 

P 

(7) 

35 

89 

9 

R 

(8) 

34 

87 

9 

R 

(9) 

19 

49 

6 

.04 

P 

(10) 

27 

69 

7 

.04 

P 

87(1) 

35 

89 

8 

.12 

ft 

(2) 

36 

92 

8 

.12 

ft 

(3) 

36 

92 

9 

R 

(4) 

33 

84 

7 

.05 

P 
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TABLE  V 
PART  III 
(continued) 


No.  of 

Total 

Percent 

Total  No. 

Item 

Correct 

Passing  Item 

of  Failures 

Value 

87(5) 

28 

72 

7 

.07 

(6) 

25 

64 

12 

(7) 

35 

89 

10 

(8) 

39 

100 

10 

(9) 

28 

72 

6 

.03 

(10) 

29 

74 

10 

(11) 

26 

66 

9 

(12) 

38 

97 

10 
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TABLE  V 
PART  V 


No, of  Total  Percent  Total  No. 


Item 

Correct 

Passing  Item 

of  Failures 

Value 

P *0,  or  R 

103 

33 

85 

7 

.05 

P 

104 

18 

46 

4 

.01 

P 

105 

29 

74 

8 

Q. 

106 

38 

97 

8 

.12 

Q, 

107 

23 

39 

13 

R 

108 

18 

46 

10 

R 

109 

8 

20 

7 

.05 

P 

no 

36 

92 

8 

.12 

Q, 

111 

30 

77 

3 

.01 

P 

112 

34 

87 

7 

.05 

P 

113 

37 

93 

8 

.12 

Q, 

114 

37 

93 

9 

R 

115 

20 

31 

10 

R 

116 

28 

72 

10 

R 

117 

24 

62 

3 

.04 

P 

118 

34 

87 

5 

.01 

P 

119 

32 

82 

10 

R 

120 

14 

36 

6 

.03 

P 

121 

13 

38 

10 

R 

122 

28 

72 

8 

R 

123 

34 

87 

7 

.05 

P 

124 

8 

20 

8 

.12 

Q 

125 

31 

79 

10 

R 

126 

4 

10 

10 

R 

127 

34 

87 

10 

R 

128 

10 

26 

13 

R 

129 

29 

74 

12 

R 

130 

37 

93 

9 

R 

131 

10 

26 

9 

R 
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TABLE  VI 


SUMMARY  OF  INDIVIDUAL  ITEM  ANALYSIS 


Section  of  Test 

Passing 

Questionable 

Rejected 

Totals 

Part  I 

7 

10 

30 

47 

Part  II 

19 

24 

105 

148 

Part  III 

14 

9 

28 

51 

Part  V 

9 

5 

13 

29 

Totals 

49 

48 

178 

275 

Complying  with  the  method  of  item  validation  by 
sequential  selection,  49  items  were  passed,  48  were  question 
able,  - indicating  that  there  is  a possibility  that  the  item 
might  be  considered  a satisfactory  one,  but  this  cannot  be 
established  on  the  basis  of  the  present  data  - and  173  items 
were  rejected.  This  is  conclusive  evidence  that  the  items 
in  general  are  not  dis  criminating  between  the  high  and  low 
achievers.  The  possibilities  are: 

1.  The  writer  not  being  the  teacher,  and  not  having 
had  formal  instruction  in  the  course,  failed  to 
master  the  materials  presented  to  the  classes  suf- 
ficiently to  enable  the  construction  of  discriminating 
items . 

2.  A majority  of  the  items  were  failures  because  they 
were  too  easy  and  were  answered  correctly  by  both  top 

and  bottom  groups.  These  areas  may  have  been  taught 
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for  mastery  and  the  objectives  realized.  In  this  case,  the 


items  are  good  in  themselves. 

3.  Since  the  group  is  homogenous  in  nature,  the  items 
with  a low  percent  passing  did  not  discriminate  be- 
cause these  areas  did  not  receive  much  emphasis  in 
class  discussion. 

4.  The  instructors  varied  in  the  presentation  of  their 
materials  to  the  extent  that  most  students  of  one 
instructor  failed  items  that  those  of  another  in- 
structor may  have  passed,  thus  causing  a type  of 
scatter  in  scores  that  would  make  discrimination 

in  the  total  group  difficult. 


Correlation  of  Sequence  Items  with  Total  Test  Scores 

Part  IV  contained  fifteen  items  to  be  arranged  in 
logical  sequence  and  was  designed  to  test  an  over-all  under- 
standing of  the  step-by-step  procedure  in  the  application  of 
the  Work  Simplification  Pattern.  "Sims1  original  formula 

S ■ n - 2d  was  used  in  the  scorir^  of  the  item  in  which  n 
n 

was  the  number  of  the  items  in  the  set  and  d the  arithriE  tic 
sum,  without  regard  to  sign  of  the  student fs  deviation  from 
the  true  order.  The  underlying  assumptions  in  the  use  of 
this  formula  are: 

1.  There  should  be  a straight  line,  but  inverse,  relation - 


* Verner  M.  Sims,  "A  Note  on  Scoring  the  Rearrangement  Test”, 
Journal  of  Educational  Psychology ,28 , April,  1937,  p.302. 

I— — - — ■ — — — - 


! il 


. 

. 

, 


3^-  . :■  ; oo  . . 

l;--  .no  i-  c StO  o«. 


* - 


, 

, 


. 


. 


ship  between  the  score  and  the  sum  of  the  deviations 
from  the  true  order. 

2.  A perfect  score  should  be  equal  to  the  number  of 
items  in  the  set. 

3.  The  worst  possible  arrangement  should  receive  0. 

The  correlation  between  the  scores  of  individuals 
on  this  sequence  item  with  the  total  scores  on  the  test  was 
yielded  as  .60.  This  correlation  is  higher  than  .34  reported 
by  *Sims  in  the  study  where  a sequence  item  test  was  compared 
with  other  measures  of  achievement.  Sims1  conclusions  re- 
garding his  sequence  items  that  were  similar  to  those  in  this 
study  are  pertinent  here: 

**  "The  particular  tests  used  here  correlated  positively 
but  not  too  highly  with  other  measures  of  achievement  and 
intelligence.  It  seems  safe  to  conclude  that  wherever  the 
desire  is  to  measure  ability  to  relate  items  to  some  desig- 
nated basis,  the  rearrangement  test  will  give  satisfactory 
measurement.  Perhaps  we  might  add  that  when  the  number  of 
available  items  is  limited,  the  longer  the  set  the  more 
satisfactory  the  measurement.  This  last  conclusion  should 
be  limited  to  college  students." 


* Verner  Martin  Sims,  "An  Evaluation  of  Five -Ten -and -Fifteen 
Item  Rearrangement  Tests",  Journal  of  Educational  Psycholog, 
23;  April, 1934,  p.256. 

**  Sims,  ibid. 
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CHAPTER  V 


SUMMARY  AM)  CONCLUSIONS 


Summary 

The  purpose  of  the  study  was  to  construct  and 
evaluate  an  objective  test  to  measure  the  learning  outcomes 
of  a semester  course  in  Work  Simplification,  given  at  the 
college  level. 

Test  Construction-The  following  procedure  was  used  in 
the  construction  of  the  test: 

1.  Determination  of  the  objectives  in  the  course. 

2.  Careful  study  of  assigned  readings,  lecture  notes, 
former  subjective  tests,  and  other  materials  handled 
in  the  course  to  insure  curricular  validity  for  the 
test. 

3.  Check  for  emphases  in  materials  of  instruction  by 
conference  with  instructors  in  the  course. 

4.  Preparation  of  preliminary  draft,  followed  by  con- 
ference with  instructors  for  criticism  of  items  and 
for  check  on  answer  key. 

Administration -The  test  was  administered  to  39  students 
comprising  three  classes  of  11,  13,  and  15,  and  consisting 
primarily  of  college  seniors  and  graduate  students. 

Evaluation-The  evaluation  consisted  of  the  following: 


1.  Comparison  of  the  characteristics  of  the  three 
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variables,  objective  test,  subjective  test,  and  final 
term  marks  from  Normal  Percentile  Chart. 

2.  The  comparison  of  the  medians  and  standard  deviations 
of  the  variables. 

3.  The  interpretation  of  the  objective  test  results  for 
class  use  in  assigning  letter  grades  and  locating 

pe rcentiles. 

4.  Computing  the  reliability  of  the  objective  test  by 
"Chance -Halves”  Method. 

3.  Obtaining  and  interpreting  the  correlation  coefficients 
of : 

a.  Objective  test  and  subjective  test. 

^ b.  Objective  test  and  final  marks. 

c.  Subjective  test  and  final  marks. 

6.  Analysis  of  individual  items  and  distractors  for  dis- 
crimination between  high  and  low  achievers. 

7.  Obtaining  and  interpreting  the  correlation  coefficient 
of  sequence  items  with  the  total  test  scores. 

Conclusions 

1.  The  test  has  curricular  validity  for  the  college 
students  in  the  course  on  Work  Simplification. 

2.  The  percentile  lines  of  the  objective  test,  subjective 
test,  and  final  marks  are  symmetrical  and  negatively 
skewed . 

!►.  3.  The  negative  skewness  is  probably  normal  for  this 
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particular  group. 

4.  The  objective  test  scores  of  the  group  were  lower 
than  the  subjective  scores  and  the  final  grades. 

3.  The  variability  of  the  longer  objective  test  was 
greater  than  that  of  the  subjective  test  and  the 
final  marks: 


Objective  Test 

SD 

14 

Subjective  Test 

SD 

9.23 

Final  Marks 

SD 

8.3 

6.  The  estimated  reliability  of  the  objective  test  by 
the  Chance -Halves  Method  and  Spearman  Brown  Prophecy 
formula  was  0.83  and  significant. 

7.  The  subjective  test  correlated  more  highly  with  the 
final  marks  than  the  objective  test  did. 

r » .36  for  subjective  test  and  final  marks, 
r s .47  Tor  objective  tests  and  final  marks. 

8.  The  low  correlation  of  .39  between  the  objective  test 
and  the  subjective  test  indicates  that  the  two  tests 
are  measuring  differently. 

9.  The  individual  items  in  the  test,  as  revealed  by  the 
Walker  technique,  are  not  statistically  valid: 

49  Passing 
48  Questionable 
17S  Rejected 
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10.  The  correlation  of  .60  between  the  sequence  item 
and  the  total  scores  is  positive  but  not  too  high. 

11.  It  is  difficult  to  construct  individual  test  items 
that  are  statistically  valid  unless  the  writer  of 
the  items  is  the  instructor  or  has  attended  the 
classes  given  in  the  course. 

Suggestion  for  Further  Research  - An  objective  test,  having 
not  only  curricular  validity  but  statistical  validity,  could 
be  constructed  for  this  course  in  Work  Simplification. 
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Parts  I,  III,  V 

Place  a y before  the  items  answered  correctly. 

Count  these  it  eras  for  each  part  and  record  the  values  in  the 
designated  blanks  on  the  cover  sheet  of  the  test. 

Part  II 

Place  a y before  items  that  are  erroneously  checked 
or  that  the  student  has  failed  to  check.  Count  up  these 
items,  subtract  from  91,  the  total  possible  score,  and  record 
p this  value  on  the  designated  blank  on  the  answer  sheet. 

Part  IV 

Use  Sims*  formula  for  sequence  items.  S = n - 2d 

. n 

in  which  n is  15,  the  number  of  items  in  the  set,  and  d the 
arithmetic  sum  without  regard  to  sign  of  the  student fs 
deviation  from  the  true  order.  Record  this  value  in  the 
designated  blank  on  the  cover  sheet  of  the  test. 

Total  Score 

Add  the  various  values  for  Parts  I,  II,  III,  IV, 

V on  the  cover  sheet  and  record  it  on  the  designated  blank 
as  the  total  score  made  by  the  student  in  the  test. 
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APPENDIX  B 


Key  to  Objective  Test  on 
Work  Simplification 


PART  I 


1) 

c 

25) 

c 

48) 

c , 

a 

2 

c 

26) 

a 

49) 

a, 

b, 

c 

3) 

a 

27) 

a 

50) 

a , 

a 

4) 

a 

28) 

c 

5D 

a, 

b 

5) 

b 

29) 

a 

52) 

b, 

a 

6) 

c 

30) 

a 

53) 

a , 

C, 

a 

7) 

b 

3D 

a 

54) 

b , 

a 

8) 

a 

32) 

c 

55) 

a, 

C, 

a 

9) 

b 

33) 

b 

56) 

a , 

C, 

a 

10) 

b 

34) 

c 

57) 

b, 

c 

11) 

c 

35) 

a 

58) 

c , 

a 

12) 

c 

36) 

a 

59) 

a , 

c 

13) 

c 

37) 

b 

60) 

a, 

C, 

a 

14) 

b 

38) 

a 

61) 

b , 

C, 

a, 

e 

15) 

b 

39) 

b 

62) 

b , 

c, 

a 

16) 

c 

40) 

a 

63) 

a , 

C, 

e 

17) 

c 

41) 

c 

64) 

a , 

b, 

c, 

a, 

e, 

f, 

18) 

a 

42) 

b 

g, 

b, 

1, 

b, 

1 

19) 

a 

43) 

a 

65 ) 

a , 

C, 

g, 

b, 

1, 

j 

20) 

c 

44) 

a 

66) 

a , 

b, 

c, 

a 

21) 

a 

45) 

c 

67) 

b, 

a 

22) 

a 

46) 

c 

68) 

a , 

b, 

G, 

a 

23) 

d 

47) 

b 

69) 

c 

24) 

a 

70) 

a, 

b, 

C 

7D 

b 

72) 

a 

73) 

a 

74) 

a, 

b, 

C, 

a 

75) 

c, 

a, 

e, 

f 

76) 

c 

77) 

b 

78) 

b, 

a 

79) 

a, 

c, 

a 
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APPENDIX  B 
(continued ) 


PART 

III 

80 

(1) 

c 

85  (1) 

h 

87  (6) 

n 

(2) 

d 

(2) 

j 

(7) 

d 

(3) 

b 

(3) 

1 

(8) 

m 

81 

(1) 

c 

(4) 

k 

(9) 

k 

(2) 

g 

(3) 

a 

(10) 

0 

(3) 

e 

(6) 

i 

(11) 

P 

(4) 

a 

17) 

d 

(12) 

82 

(1) 

e 

(8) 

e 

(2) 

d 

86  (1) 

n 

121 

b 

a 

(2) 

(3) 

1 

b 

83 

(1) 

t 

(4) 

m 

(2) 

a 

(3) 

a 

(3) 

h 

(6) 

k 

(4) 

c 

(7) 

j 

(3) 

d 

(8) 

e 

84 

(1) 

b 

(9) 

c 

(2) 

d 

(10) 

g 

(3) 

h 

87  U) 

c 

(4) 

g 

(2) 

f 

(5) 

f 

(3) 

r 

(4) 

g 

(3) 

1 

PART  IV 

88) 

3 

93) 

12 

98) 

13 

89) 

14 

94) 

1 

99) 

11 

90) 

8 

95) 

2 

100) 

7 

9D 

10 

96) 

6 

101) 

4 

92) 

13 

97) 

9 

102) 

3 

,<v 
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APPENDIX  B 


(continued ) 


PART  V 


103) 

1 

113) 

1 

123) 

1 

104) 

0 

114) 

0 

124) 

2 

105) 

1 

115) 

2 

125) 

1 

106) 

1 

116) 

1 

126) 

1 

107) 

2 

117) 

1 

127) 

1 

108) 

2 

118) 

1 

128) 

2 

109) 

0 

119) 

0 

129) 

1 

no) 

1 

120) 

0 

130) 

1 

in) 

1 

121) 

0 

131) 

2 

112) 

1 

122) 

0 
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